Local Model Benchmarks

Local test machine: Apple M5 Pro · 64 GB unified memoryRun window 29 September — 18 October 202622 recorded runs

2 October 2026 · Agentic game · isometric 3D

Digger 3D · Sushi 1.1.0

Session completed Local run

Completed a deterministic Digger game with grid simulation and isometric Three.js presentation.

Digger 3D voxel maze with the player, enemies and level HUD visible
Digger 3D · gameplay capture

What was checked

  • TypeScript check and Vite production build passed.
  • 28 of 28 self-tests passed.
  • All five levels passed connectivity, emerald-access and bag-support validation.
  • Playwright title/game capture completed; no console errors were reported.

Limits of this evidence

TTFT and peak process/system RAM were not recorded. Prefill includes cache reuse and is not a cold-prefill measurement. Functional checks are transcribed from the run report and were not rerun during archival.

Configuration

The model, serving engine and agent used for this execution.

Recorded configuration and setup details
FieldValueDetail
Model · primaryQwen 3.8 Flash Next · primaryEXL3 2.625 bpw
RuntimeSushi 1.1.0 · MLX 0.32.3inference engine and exact build
HarnessPi coding agentthe agent or client that drove the run
HardwareApple M5 Pro · 64 GB unified memoryhardware recorded for this execution
WorkloadDigger 3D · revision 1Long-horizon coding-agent challenge; not directly comparable with a fixed task suite.
Repetitions1executions recorded for this workload; one means an indicative result, not an estimate

Inference measurements

Engine-side rates for this run. Each figure states its own statistic; figures from different runs are not interchangeable.

Inference measurements: recorded value and measurement definition
MetricValueDefinition
Cache hit ratio93.79 %aggregate · n=1
Decode · per-request median39.45 tok/smedian · n=128
Decode · output-weighted35.99 tok/stotal output tokens / summed per-request decode time · n=128
Prefill · median456.15 tok/smedian; includes cache reuse · n=128
Prefill · mean418.91 tok/smean; includes cache reuse · n=128
MTP acceptance73.48 %accepted draft tokens / drafted tokens · n=122523 · 90,036 accepted out of 122,523 drafted tokens.

Agent session counters

Agent-wide usage totals. These include reasoning, tool calls and waiting, and are not model decode speed.

Agent session counters: recorded value and measurement definition
MetricValueDefinition
Session elapsed117.8 minfirst instruction to final response · n=1
Session start to end118.0 minelapsed · n=1
Matched model requests128 requestsmatched · n=1
Tool calls171 callstotal · n=1
Context compactions2 compactionstotal · n=1

Context and token counters

Token totals as reported by the harness or engine. Cached and cumulative figures are not additive with fresh input.

Context and token counters: recorded value and measurement definition
MetricValueDefinition
Maximum prompt context113,288 tokensmaximum · n=1
Output tokens194,071 tokenstotal · n=1
Fresh input502,196 tokenstotal · n=1
Cached input7,582,258 tokenstotal · n=1

Recorded check counters

Counts from the checks recorded with this run.

Recorded check counters: recorded value and measurement definition
MetricValueDefinition
Self-tests passed28 teststotal · n=1
Levels validated5 levelstotal · n=1
Request records & provenance

128 matched requests in run order, paired monotonically by exact prompt/output token counts. Includes numeric token counts, throughput and MTP counters only; raw prompts/responses, event timestamps and server-log row IDs are omitted.

Run ID: 2026-10-02-qwen38-flash-next-sushi-digger-3d

One execution, with checks transcribed from the retained record. A completed session is not a quality score. Measurement method · All runs