Lava lamp v1 · Codex CLI · run d3591876 · 02.10.2026 06:05 Tallinn
GPT-5.6 Sol
Medium effortDoes not work
6 of 8 checks passed. 1 of 5 blocker checks failed.
What it built: 3 captures
Build time
2m 20s
5th fastest of 11 models at medium effort. Wall time, start to graded: 3m 20s.
Output tokens
7,254
3rd fewest of 11 models at medium effort.
Output speed
52 tok/s
8th highest of 11 models at medium effort.
API cost
Not reported
Codex CLI does not report a list-price estimate.
Along the row
GPT-5.6 Sol at every effort.
Down the column
Other models at medium effort.
Fastest median first · this run: 2m 20s
GPT-6.1 Terra47.9 sWorks
2.9× faster than this run
GPT-5.6 Luna59.1 sWorks
2.4× faster than this run
GPT-6 Luna1m 21sWorks
1.7× faster than this run
GPT-5.6 Terra1m 48sWorks
1.3× faster than this run
GPT-6 Astra4m 15sWorks
1.8× slower than this run
Claude Sonnet 5.54m 44sWorks
2.0× slower than this run
GPT-6.1 Sol4m 52sWorks
2.1× slower than this run
Claude Fable 5.14m 53sWorks
2.1× slower than this run
Claude Haiku 5.55m 06sWorks
2.2× slower than this run
Claude Opus 5.58m 56sWorks
3.8× slower than this run
GPT-6 Sol—Works
Hidden checks
6 of 8 checks passed.
- Self-contained index.html is presentblocker
- Visible page contentblocker
- Visible autonomous animationblocker
- Accessible on/off controlextra
- 390 px mobile layout has no horizontal overflowextra
- Local animation frame performanceextra
- No browser errorsblocker
- No attempted external or linked-resource requestsblocker
It works when every blocker passes. How it looks is reviewed blind: pending.
Run details
- Video (video): not published, videos are withheld. SHA-256 33478bc36b46ea79740ce24526d2c335a116bc078bc30f0235b8c1f30cbb7307, 915.8 KB.
- Run ID
- d3591876-e27f-40bc-937e-a544d3ccb616
- Benchmark
- lava-lamp v1
- Experiment
- Single run
- Started
- 02.10.2026 06:05 Tallinn
- Graded
- revision 1 · 02.10.2026 06:08
Works and checks, in full
1 of 5 blocker checks failed.
The rule: a run works when every blocker check passes. If any blocker fails it does not work. If none fails but one has no result yet, it stays pending, never counted as a pass or a fail. Extra checks are reported but do not decide it. Works is not a judgement of looks: that is the visual review.
This is a legacy contract v1 run: the task has no public requirements, and these are the original lava-lamp checks, not a versioned hidden verifier. It is never compared with contract v2 runs.
| Requirement | Check | Blocker | Result |
|---|---|---|---|
| none (v1) | Self-contained index.html is present | Blocker | pass |
| none (v1) | Visible page content | Blocker | pass |
| none (v1) | Visible autonomous animation | Blocker | fail |
| none (v1) | Accessible on/off control | Extra | pass |
| none (v1) | 390 px mobile layout has no horizontal overflow | Extra | fail |
| none (v1) | Local animation frame performance | Extra | pass |
| none (v1) | No browser errors | Blocker | pass |
| none (v1) | No attempted external or linked-resource requests | Blocker | pass |
Verification completed; eligible for benchmark results.
Visual review
Pending.
Pending: the captures have not been reviewed blind yet. Checks decide whether it works; how it looks is decided only in that review.
What ran
Requested and detected.
Detected values come from the run’s own output, never from our settings.
| Field | Requested | Detected | Evidence |
|---|---|---|---|
| Model | gpt-5.6-sol | not reported | The harness reported no model. |
| Effort | medium | not reported | The harness reported no effort; the requested effort is shown. |
| Harness | Codex CLI | codex-cli 0.160.0 | Version as the CLI reported it; binary SHA-256 112fae7a5a12… |
| Deadline | 10 min | 3m 20s used | Completed |
Tool decisions
The harness reports no permission decision for its tool calls; the result of each call is still recorded.
- command_execution3 calls
- file_change2 calls
Telemetry
Time and usage.
- Generation time
- 2m 20s
- First content
- 4.3 s
- Output speed
- 51.6 tokens/s, whole run including tools
- API-equivalent cost
- not reported
- Actual charge
- not reported
- Billing
- subscription
Input tokens
- Cache reads40,83259%
- Cache writesnot reported
- Uncached input28,64041%
Output tokens
- Output7,254100%
- Reasoningnot reported
Usage as the agent reported it at the end of the run. Cache reads are part of input; reasoning is part of output.
Transcript and source
Plain-text downloads.
The redacted transcript and the frozen output bundle, with LF line endings. Hashes are of the original files.
Redacted agent transcript: 2.4 KB, 0 redactions. Download transcript.txt
Source files
| File | Size | SHA-256 | Redactions |
|---|---|---|---|
| index.html | 12.8 KB | f936610be121773a7dc41527b29576e71fe49ca48480c5cec23776945e798d7a | 0 |
Revision history
This page shows revision 1.
Grades are append-only: a regrade adds a revision and never rewrites an earlier one.
| Revision | Graded | Works |
|---|---|---|
| 1 (current) | 02.10.2026 06:08 | does not work |
Redaction: automated scan run; checked by Jaanus on 27.10.2026 08:01. Nothing needed redacting.


