Lava lamp v1 · Codex CLI · run 0e1f62c1 · 28.10.2026 08:39 Tallinn
GPT-5.6 Sol
Extra high effortDoes not work
6 of 8 checks passed. 2 of 5 blocker checks failed.
What it built: 3 captures
Build time
4m 05s
4th fastest of 12 models at extra high effort. Wall time, start to graded: 5m 05s.
Output tokens
17,077
4th fewest of 12 models at extra high effort.
Output speed
70 tok/s
8th highest of 12 models at extra high effort.
API cost
Not reported
Codex CLI does not report a list-price estimate.
Along the row
GPT-5.6 Sol at every effort.
Down the column
Other models at extra high effort.
Fastest median first · this run: 4m 05s
GPT-6.1 Terra1m 15sWorks
3.3× faster than this run
GPT-5.6 Luna1m 25sWorks
2.9× faster than this run
GPT-5.6 Terra3m 50sWorks
1.1× faster than this run
GPT-6 Luna4m 24sWorks
1.1× slower than this run
GPT-6 Sol7m 11sWorks
1.8× slower than this run
Claude Haiku 5.58m 28sWorks
2.1× slower than this run
GPT-6.1 Sol11m 37sWorks
2.8× slower than this run
Claude Sonnet 5.521m 18sWorks
5.2× slower than this run
GPT-6 Astra25m 55sWorks
6.3× slower than this run
Claude Opus 5.528m 09sWorks
6.9× slower than this run
Claude Fable 5.132m 58sWorks
8.1× slower than this run
Hidden checks
6 of 8 checks passed.
- Self-contained index.html is presentblocker
- Visible page contentblocker
- Visible autonomous animationblocker
- Accessible on/off controlextra
- 390 px mobile layout has no horizontal overflowextra
- Local animation frame performanceextra
- No browser errorsblocker
- No attempted external or linked-resource requestsblocker
It works when every blocker passes. How it looks is reviewed blind: pending.
Run details
- Video (video): not published, videos are withheld. SHA-256 53dfd3b3e5538b163da1624dd5e73a36dd260773aca13d6eec69dce9cd4727ed, 854.8 KB.
- Run ID
- 0e1f62c1-242e-4980-aae7-642d5074bd77
- Benchmark
- lava-lamp v1
- Experiment
- Single run
- Started
- 28.10.2026 08:39 Tallinn
- Graded
- revision 1 · 28.10.2026 08:44
Works and checks, in full
2 of 5 blocker checks failed.
The rule: a run works when every blocker check passes. If any blocker fails it does not work. If none fails but one has no result yet, it stays pending, never counted as a pass or a fail. Extra checks are reported but do not decide it. Works is not a judgement of looks: that is the visual review.
This is a legacy contract v1 run: the task has no public requirements, and these are the original lava-lamp checks, not a versioned hidden verifier. It is never compared with contract v2 runs.
| Requirement | Check | Blocker | Result |
|---|---|---|---|
| none (v1) | Self-contained index.html is present | Blocker | pass |
| none (v1) | Visible page content | Blocker | pass |
| none (v1) | Visible autonomous animation | Blocker | fail |
| none (v1) | Accessible on/off control | Extra | pass |
| none (v1) | 390 px mobile layout has no horizontal overflow | Extra | pass |
| none (v1) | Local animation frame performance | Extra | pass |
| none (v1) | No browser errors | Blocker | fail |
| none (v1) | No attempted external or linked-resource requests | Blocker | pass |
Verification completed; eligible for benchmark results.
Visual review
Pending.
Pending: the captures have not been reviewed blind yet. Checks decide whether it works; how it looks is decided only in that review.
What ran
Requested and detected.
Detected values come from the run’s own output, never from our settings.
| Field | Requested | Detected | Evidence |
|---|---|---|---|
| Model | gpt-5.6-sol | not reported | The harness reported no model. |
| Effort | xhigh | not reported | The harness reported no effort; the requested effort is shown. |
| Harness | not recorded | codex-cli 0.165.0 | Version as the CLI reported it; binary SHA-256 a45099154d7f… |
| Deadline | 60 min | 5m 05s used | Completed |
Tool decisions
The harness reports no permission decision for its tool calls; the result of each call is still recorded.
- command_execution7 calls · 1 failed
- file_change3 calls
Telemetry
Time and usage.
- Generation time
- 4m 05s
- First content
- 3.6 s
- Output speed
- 69.7 tokens/s, whole run including tools
- API-equivalent cost
- not reported
- Actual charge
- not reported
- Billing
- subscription
Input tokens
- Cache reads236,67295%
- Cache writesnot reported
- Uncached input11,3174.6%
Output tokens
- Output17,077100%
- Reasoningnot reported
Usage as the agent reported it at the end of the run. Cache reads are part of input; reasoning is part of output.
Transcript and source
Plain-text downloads.
The redacted transcript and the frozen output bundle, with LF line endings. Hashes are of the original files.
Redacted agent transcript: 7.9 KB, 0 redactions. Download transcript.txt
Source files
| File | Size | SHA-256 | Redactions |
|---|---|---|---|
| index.html | 29.8 KB | 9629116bebbc5c8e1b444bfd71343acfca11653a7fe714fc767549cb2861e36b | 0 |
Revision history
This page shows revision 1.
Grades are append-only: a regrade adds a revision and never rewrites an earlier one.
| Revision | Graded | Works |
|---|---|---|
| 1 (current) | 28.10.2026 08:44 | does not work |
Redaction: automated scan run; checked by Jaanus on 28.10.2026 17:51. Nothing needed redacting.