The Manifest

Outlier26 of 26

August.Here.Now/systemsbench

SystemsBench: an open benchmark for systems thinking in AI. A page, with sponsor seats.

Seat$111a month
Open3 of 3seats
WholeNot offered

A seat is a named place on this site, beside August's work. How Renting Works

August.Here.Now/systemsbench home page
August.Here.Now/systemsbench on a phone

What It Is Now

SystemsBench, the open-source benchmark for systems intelligence in large language models. It asks whether a model can map a system, find the leverage and know when it is wrong. Version 0.17 is a research preview on GitHub.

The Name

A page on August's corner of here.now. The benchmark itself belongs to Outlier.Systems.

What We Are Moving On

  • Version 0.17 is open source on GitHub, with five scorers, a blind jury and a 354-item register.

Help We Need

Where It Could Go

Paths to start from. Or bring your own idea.

  1. 1

    Research Sponsor

    Fund the next version of the benchmark, credited in the release.

    Ask About This Path
  2. 2

    Lab Runs

    A lab runs SystemsBench on its own models, and the results are published either way.

    Ask About This Path
  3. 3

    A Domain Of Its Own

    SystemsBench moves to its own domain, with a sponsor named at its start.

    Ask About This Path

Open Questions

Ways To Rent It

Seat $111 a month

A sponsor seat. It funds the next version, and sponsors are credited in the release.

3 of 3 seats open.

Seats only. The whole domain is not offered.

Price By Term

TermUSDBTCDASH
1 month $111……
3 months 5% off$316……
6 months 11% off$593……
12 months 22% off$1,039……

DASH totals include 5% off, after the term discount. BTC and DASH follow the live rate. Your invoice fixes the amount.

Every Rent Includes

  • Early Code

    Early access to the code being developed for your domain.

  • Updates First

    Early access to updates as they ship.

  • Decided Together

    You and August decide how your seat or domain is used.

  • August, Directly

    You talk with August himself.

  • Access Over Time

    August shares more access the longer you stay. What opens, and when, goes into your agreement.

Ask About August.Here.Now/systemsbench

Seat $111/mo
Ask