Lava lamp v1 · Codex CLI · run d3591876 · 02.10.2026 06:05 Tallinn

GPT-5.6 Sol

Medium effort

Does not work

6 of 8 checks passed. 1 of 5 blocker checks failed.

What it built: 3 captures

Desktop capture of Codex CLI (GPT-5.6 Sol)'s output on Lava lamp v1, medium effort, 02.10.2026 06:05 (run d3591876)
Desktop · 280.0 KB · ab1d04d63446…
Phone capture of Codex CLI (GPT-5.6 Sol)'s output on Lava lamp v1, medium effort, 02.10.2026 06:05 (run d3591876)
Phone · 102.9 KB · 9f148155c9ec…
Motion capture of Codex CLI (GPT-5.6 Sol)'s output on Lava lamp v1, medium effort, 02.10.2026 06:05 (run d3591876)
Motion · 280.0 KB · ab1d04d63446…

Along the row

GPT-5.6 Sol at every effort.

  1. GPT-5.6 Sol at low effort: desktop capture of run 184f5448 Low1m 46s

    Works

    1 run
  2. GPT-5.6 Sol at medium effort: desktop capture of run d3591876 Medium2m 20s

    Fails

    This effort
  3. GPT-5.6 Sol at high effort: desktop capture of run 456bc2ff High2m 34s

    Works

    1 run
  4. GPT-5.6 Sol at extra high effort: desktop capture of run 0e1f62c1 Extra high4m 05s

    Fails

    1 run
  5. GPT-5.6 Sol at max effort: desktop capture of run 5a62dd4e Max7m 53s

    Fails

    1 run

Down the column

Other models at medium effort.

Fastest median first · this run: 2m 20s

  1. GPT-6.1 Terra at medium effort: desktop capture of run f2424202GPT-6.1 Terra47.9 s

    Works

    2.9× faster than this run
  2. GPT-5.6 Luna at medium effort: desktop capture of run 69d0eb8eGPT-5.6 Luna59.1 s

    Works

    2.4× faster than this run
  3. GPT-6 Luna at medium effort: desktop capture of run 0e2e690dGPT-6 Luna1m 21s

    Works

    1.7× faster than this run
  4. GPT-5.6 Terra at medium effort: desktop capture of run 69024137GPT-5.6 Terra1m 48s

    Works

    1.3× faster than this run
  5. GPT-6 Astra at medium effort: desktop capture of run d0b2c47fGPT-6 Astra4m 15s

    Works

    1.8× slower than this run
  6. Claude Sonnet 5.5 at medium effort: desktop capture of run 2152d2b4Claude Sonnet 5.54m 44s

    Works

    2.0× slower than this run
  7. GPT-6.1 Sol at medium effort: desktop capture of run 0d942441GPT-6.1 Sol4m 52s

    Works

    2.1× slower than this run
  8. Claude Fable 5.1 at medium effort: desktop capture of run 6d90c6ceClaude Fable 5.14m 53s

    Works

    2.1× slower than this run
  9. Claude Haiku 5.5 at medium effort: desktop capture of run 012cc119Claude Haiku 5.55m 06s

    Works

    2.2× slower than this run
  10. Claude Opus 5.5 at medium effort: desktop capture of run 483f29b0Claude Opus 5.58m 56s

    Works

    3.8× slower than this run
  11. GPT-6 Sol at medium effort: desktop capture of run 18de4544GPT-6 Sol—

    Works

Hidden checks

6 of 8 checks passed.

  • Self-contained index.html is presentblocker
  • Visible page contentblocker
  • Visible autonomous animationblocker
  • Accessible on/off controlextra
  • 390 px mobile layout has no horizontal overflowextra
  • Local animation frame performanceextra
  • No browser errorsblocker
  • No attempted external or linked-resource requestsblocker

It works when every blocker passes. How it looks is reviewed blind: pending.

Run detailsagent config, what ran, tokens, source and revisions
  • Video (video): not published, videos are withheld. SHA-256 33478bc36b46ea79740ce24526d2c335a116bc078bc30f0235b8c1f30cbb7307, 915.8 KB.
Run ID
d3591876-e27f-40bc-937e-a544d3ccb616
Benchmark
lava-lamp v1
Experiment
Single run
Started
02.10.2026 06:05 Tallinn
Graded
revision 1 · 02.10.2026 06:08

Works and checks, in full

1 of 5 blocker checks failed.

The rule: a run works when every blocker check passes. If any blocker fails it does not work. If none fails but one has no result yet, it stays pending, never counted as a pass or a fail. Extra checks are reported but do not decide it. Works is not a judgement of looks: that is the visual review.

This is a legacy contract v1 run: the task has no public requirements, and these are the original lava-lamp checks, not a versioned hidden verifier. It is never compared with contract v2 runs.

Contract v1 checks for this run, with blocker and result
RequirementCheckBlockerResult
none (v1)Self-contained index.html is presentBlockerpass
none (v1)Visible page contentBlockerpass
none (v1)Visible autonomous animationBlockerfail
none (v1)Accessible on/off controlExtrapass
none (v1)390 px mobile layout has no horizontal overflowExtrafail
none (v1)Local animation frame performanceExtrapass
none (v1)No browser errorsBlockerpass
none (v1)No attempted external or linked-resource requestsBlockerpass

Verification completed; eligible for benchmark results.

Visual review

Pending.

Pending: the captures have not been reviewed blind yet. Checks decide whether it works; how it looks is decided only in that review.

What ran

Requested and detected.

Detected values come from the run’s own output, never from our settings.

Requested agent config beside what the run reported
FieldRequestedDetectedEvidence
Modelgpt-5.6-solnot reportedThe harness reported no model.
Effortmediumnot reportedThe harness reported no effort; the requested effort is shown.
HarnessCodex CLIcodex-cli 0.160.0Version as the CLI reported it; binary SHA-256 112fae7a5a12…
Deadline10 min3m 20s usedCompleted

Tool decisions

5 calls · 5 without a decision

The harness reports no permission decision for its tool calls; the result of each call is still recorded.

  • command_execution3 calls
  • file_change2 calls

Telemetry

Time and usage.

Generation time
2m 20s
First content
4.3 s
Output speed
51.6 tokens/s, whole run including tools
API-equivalent cost
not reported
Actual charge
not reported
Billing
subscription

Input tokens

69,472 tokens
  • Cache reads40,83259%
  • Cache writesnot reported
  • Uncached input28,64041%

Output tokens

7,254 tokens
  • Output7,254100%
  • Reasoningnot reported

Usage as the agent reported it at the end of the run. Cache reads are part of input; reasoning is part of output.

Transcript and source

Plain-text downloads.

The redacted transcript and the frozen output bundle, with LF line endings. Hashes are of the original files.

Redacted agent transcript: 2.4 KB, 0 redactions. Download transcript.txt

Source files

1 file · 12.8 KB
Files in the output bundle
FileSizeSHA-256Redactions
index.html12.8 KBf936610be121773a7dc41527b29576e71fe49ca48480c5cec23776945e798d7a0
Bundle SHA-256 f936610be121773a7dc41527b29576e71fe49ca48480c5cec23776945e798d7a

Revision history

This page shows revision 1.

Grades are append-only: a regrade adds a revision and never rewrites an earlier one.

Grading revisions of this run
RevisionGradedWorks
1 (current)02.10.2026 06:08does not work

Redaction: automated scan run; checked by Jaanus on 27.10.2026 08:01. Nothing needed redacting.