Local Model Benchmarks

Local test machine: Apple M5 Pro · 64 GB unified memoryRun window 29 September — 18 October 202622 recorded runs

Playable builds

18 generated artifacts, grouped by task. Play the result as the model produced it, then check the run sheet for the recorded tests and limits.

Whiteout Protocol

Compare attempts →
GPT-6 Luna Digger 3D gameplay showing the isometric grid and HUD

GPT-6 Luna

GPT-6 Luna · 3 October 2026

Session completed Cloud baseline

Codex completed a Digger 3D browser game build. The retained session notes report 28/28 simulation self-tests passing and a small interactive smoke check; manual acceptance remained partial.

Three.js licence notice

Hardball 3D gameplay at the top of inning one, showing the field, players, scoreboard and ball call

Sushi 1.1.0

Qwen 3.8 Flash Next · 2 October 2026

Session completed Local run

Completed a three-inning 3D arcade baseball game with batting, pitching, fielding, scoring, and restart behavior. The visual presentation is acceptable, but gameplay does not consistently follow baseball rules.

Three.js licence notice

Hardball 3D TensorFold gameplay from behind the batter, with the inning scoreboard and field visible

TensorFold 0.6.4

Qwen 3.8 27B + Qwen 3.8 27B DFlash2 · 4 October 2026

Session completed Local run

Produced a complete playable 3D arcade baseball game. Pi’s final session summary reports gameplay and restart checks; those checks were not independently rerun while archiving.

Three.js licence notice

Wild West Showdown 3D

Compare attempts →

Local Model Benchmarks Promo

Compare attempts →
Scene 4 of the promo on the site's accent blue: the label EVERY RUN, RECORDED, the headline Every session. Every token. Every second., a run sheet in a phone frame beside the counters 76 sessions, 1,437 requests and 41.4 tok/s, and the caption

Sushi 1.2.4

Qwen 3.8 Flash Next · 18 October 2026

Session completed Local run

The orchestrator reached COMPLETE after 6 h 45 min with no operator action and no failed session, and the final reviewer accepted all 36 requirements on its first cycle. The render follows the storyboard and the site's design system and passes all 23 hidden acceptance cases. Artistically it is modest: it reads like an animated slide deck. Its opening photograph, a generated image from the supplied pack, is visibly AI-made.

anatomy skill licence notice (MIT) · Credits and licences · narration Built with Fish Audio

Custom Characters Promo

Compare attempts →
Opening frame of the vertical promo: the headline What if their drawing could talk to them? above a child's drawing of a vampire with sparkles, and the first caption

Sushi 1.2.4

Qwen 3.8 Flash Next · 17 October 2026

Session completed Local run

The orchestrator reached COMPLETE after 3 h 55 min with no operator action and no failed session, and the final reviewer accepted all 27 requirements on its first cycle. The render passes 19 of 20 hidden acceptance cases: every caption in sync, both exclusions, the full call to action and a still final hold. It hides captions in the pauses between sentences. Visually it is clean but plainer than the Opus 5.5 render of the Spanish brief.

Credits and licences · narration Built with Fish Audio

Microwave Oven Anatomy

Compare attempts →
Isometric cutaway of a countertop microwave oven with its mesh door, keypad, magnetron and cables, above power, contents, turntable and door controls

Sushi 1.2.2 → 1.2.3

Qwen 3.8 Flash Next · 13 October 2026

Session completed Local run

The orchestrator reached COMPLETE after 17 h 20 min of run time in three segments. All 23 tasks are done (22 planned at bootstrap, one added by a replan), the project's verify passes 52 checks in 95 s (limit 240 s), and the final reviewer accepted all 27 requirements. The figure is a detailed microwave cutaway with power levels, contents, turntable and door controls. An independent check found that the frozen block warms 10 times faster than liquid water instead of 10 times slower; the model's own test asserts the inverted behaviour.

anatomy skill licence notice (MIT)

Isometric cutaway of a countertop microwave oven with its transformer bay, magnetron and fan, cavity and turntable, above door, turntable, power and contents buttons

Splash 1.3.1

Qwen 3.8 27B + Qwen 3.8 27B DFlash2 · 16 October 2026

Session completed Local run

The orchestrator reached COMPLETE after 29 h 1 min in one segment, with no operator action. All 29 leaf tasks are done (16 planned at bootstrap, 6 split into smaller tasks, more added by replans and the final review), the project's verify passes 67 checks, and the final reviewer accepted all 23 requirements on its second cycle. The physics module passes all 16 hidden acceptance cases, including the frozen-block rate the Sushi attempt got wrong. The figure works in both themes, but its composition is cluttered.

anatomy skill licence notice (MIT)

Prefix Cache Anatomy

Compare attempts →
Isometric line drawing of a paper-tape relay desk with a peg rack, a shuttle and a sprocket, above four prompt buttons

Sushi 1.2.2

Qwen 3.8 Flash Next · 12 October 2026

Session completed Local run

The orchestrator reached COMPLETE after 10 h 26 min of run time in three segments. All 14 model-planned tasks are done, the project's verify passes 35 checks in 103 s (limit 240 s), and the final reviewer accepted all 26 requirements. The model invented a paper-tape telegraph relay desk whose parts show prefix reuse, partial reuse, a miss, LRU eviction and refusal. 21 of 62 sessions ended on engine memory errors; none counted against a task.

anatomy skill licence notice (MIT)

Digger Arcade

Voxel Pagoda Garden