CmdBenchby CmdBrief
Menu

Lava lamp v1 · Codex CLI · run 18de4544 · 02.10.2026 05:51 Tallinn

GPT-6 Sol

Medium effort

Works

8 of 8 checks passed. All 5 blocker checks passed.

Compare →TranscriptSource
Desktop capture of Codex CLI (GPT-6 Sol)'s output on Lava lamp v1, medium effort, 02.10.2026 05:51 (run 18de4544)
Desktop · 597.3 KB · 6437c01b3c64…
Phone capture of Codex CLI (GPT-6 Sol)'s output on Lava lamp v1, medium effort, 02.10.2026 05:51 (run 18de4544)
Phone · 265.1 KB · 680985404563…
Motion capture of Codex CLI (GPT-6 Sol)'s output on Lava lamp v1, medium effort, 02.10.2026 05:51 (run 18de4544)
Motion · 595.6 KB · d196b1ded538…

Along the row

GPT-6 Sol at every effort.

  1. GPT-6 Sol at low effort: desktop capture of run 0beb33c6 Low2m 39s

    Works

    1 run
  2. GPT-6 Sol at medium effort: desktop capture of run 18de4544 Medium—

    Works

    This effort
  3. GPT-6 Sol at high effort: desktop capture of run 5f2b6af6 High4m 12s

    Works

    1 run
  4. GPT-6 Sol at extra high effort: desktop capture of run 10bc68ff Extra high7m 11s

    Works

    1 run
  5. GPT-6 Sol at max effort: desktop capture of run f796ca14 Max13m 48s

    Works

    1 run

Down the column

Other models at medium effort.

Fastest median first

  1. GPT-6.1 Terra at medium effort: desktop capture of run f2424202GPT-6.1 Terra47.9 s

    Works

  2. GPT-5.6 Luna at medium effort: desktop capture of run 69d0eb8eGPT-5.6 Luna59.1 s

    Works

  3. GPT-6 Luna at medium effort: desktop capture of run 0e2e690dGPT-6 Luna1m 21s

    Works

  4. GPT-5.6 Terra at medium effort: desktop capture of run 69024137GPT-5.6 Terra1m 48s

    Works

  5. GPT-5.6 Sol at medium effort: desktop capture of run d3591876GPT-5.6 Sol2m 20s

    Fails

  6. GPT-6 Astra at medium effort: desktop capture of run d0b2c47fGPT-6 Astra4m 15s

    Works

  7. Claude Sonnet 5.5 at medium effort: desktop capture of run 2152d2b4Claude Sonnet 5.54m 44s

    Works

  8. GPT-6.1 Sol at medium effort: desktop capture of run 0d942441GPT-6.1 Sol4m 52s

    Works

  9. Claude Fable 5.1 at medium effort: desktop capture of run 6d90c6ceClaude Fable 5.14m 53s

    Works

  10. Claude Haiku 5.5 at medium effort: desktop capture of run 012cc119Claude Haiku 5.55m 06s

    Works

  11. Claude Opus 5.5 at medium effort: desktop capture of run 483f29b0Claude Opus 5.58m 56s

    Works

Hidden checks

8 of 8 checks passed.

  • Self-contained index.html is presentblocker
  • Visible page contentblocker
  • Visible autonomous animationblocker
  • Accessible on/off controlextra
  • 390 px mobile layout has no horizontal overflowextra
  • Local animation frame performanceextra
  • No browser errorsblocker
  • No attempted external or linked-resource requestsblocker

It works when every blocker passes. How it looks is reviewed blind: pending.

Run detailsagent config, what ran, tokens, source and revisions
  • Video (video): not published, videos are withheld. SHA-256 a5f53fc93041e1a4c8c777917f94b3314118560046b80be08408500351685c1c, 1599.2 KB.
Run ID
18de4544-9150-4361-9432-549f2691fa87
Benchmark
lava-lamp v1
Experiment
Single run
Started
02.10.2026 05:51 Tallinn
Graded
revision 1 · 02.10.2026 06:02

Works and checks, in full

All 5 blocker checks passed.

The rule: a run works when every blocker check passes. If any blocker fails it does not work. If none fails but one has no result yet, it stays pending, never counted as a pass or a fail. Extra checks are reported but do not decide it. Works is not a judgement of looks: that is the visual review.

This is a legacy contract v1 run: the task has no public requirements, and these are the original lava-lamp checks, not a versioned hidden verifier. It is never compared with contract v2 runs.

Contract v1 checks for this run, with blocker and result
RequirementCheckBlockerResult
none (v1)Self-contained index.html is presentBlockerpass
none (v1)Visible page contentBlockerpass
none (v1)Visible autonomous animationBlockerpass
none (v1)Accessible on/off controlExtrapass
none (v1)390 px mobile layout has no horizontal overflowExtrapass
none (v1)Local animation frame performanceExtrapass
none (v1)No browser errorsBlockerpass
none (v1)No attempted external or linked-resource requestsBlockerpass

Verification completed; eligible for benchmark results.

Visual review

Pending.

Pending: the captures have not been reviewed blind yet. Checks decide whether it works; how it looks is decided only in that review.

What ran

Requested and detected.

Detected values come from the run’s own output, never from our settings.

Requested agent config beside what the run reported
FieldRequestedDetectedEvidence
Modelgpt-6-solnot reportedThe harness reported no model.
Effortmediumnot reportedThe harness reported no effort; the requested effort is shown.
HarnessCodex CLIcodex-cli 0.160.0Version as the CLI reported it; binary SHA-256 112fae7a5a12…
Deadline10 min10m 59s usedStopped at the time limit

Tool decisions

5 calls · 5 without a decision

The harness reports no permission decision for its tool calls; the result of each call is still recorded.

  • command_execution3 calls
  • file_change2 calls

Telemetry

Time and usage.

Generation time
not recorded
First content
3.5 s
Output speed
not recorded
API-equivalent cost
not reported
Actual charge
not reported
Billing
subscription

Input tokens

total not reported

Input tokens usage was not reported.

  • Cache readsnot reported
  • Cache writesnot reported
  • Uncached inputnot reported

Output tokens

total not reported

Output tokens usage was not reported.

  • Outputnot reported
  • Reasoningnot reported

Usage is incomplete; missing categories stay unknown. Cache reads are part of input; reasoning is part of output.

Transcript and source

Plain-text downloads.

The redacted transcript and the frozen output bundle, with LF line endings. Hashes are of the original files.

Redacted agent transcript: 1.3 KB, 0 redactions. Download transcript.txt

Source files

1 file · 20.7 KB
Files in the output bundle
FileSizeSHA-256Redactions
index.html20.7 KBdd80ac77302552497e42c0dcfb091404f829833e1851452b2a2a48bd5b6c2c8e0
Bundle SHA-256 dd80ac77302552497e42c0dcfb091404f829833e1851452b2a2a48bd5b6c2c8e

Revision history

This page shows revision 1.

Grades are append-only: a regrade adds a revision and never rewrites an earlier one.

Grading revisions of this run
RevisionGradedWorks
1 (current)02.10.2026 06:02works

Redaction: automated scan run; checked by Jaanus on 27.10.2026 08:01. Nothing needed redacting.

Download run.json