Local Model Benchmarks

Local test machine: Apple M5 Pro · 64 GB unified memoryRun window 29 September — 18 October 202622 recorded runs

1 October 2026 · Agentic game · arcade

Digger Arcade

Session completed Local run

Completed a playable arcade Digger game and reported end-to-end verification.

Digger Arcade gameplay on level one, showing the player, enemies, gems and score HUD
Digger Arcade · gameplay capture

What was checked

  • TypeScript check and Vite production build passed.
  • 22 of 22 self-tests passed in headless and browser runs.
  • 14,400-frame smoke run traversed all five boards without NaN or a stuck player.
  • Five levels passed connectivity and floating-bag validation.
  • No console errors or warnings were reported in the checked game states.

Limits of this evidence

TTFT and peak RAM were not recorded. Prefill includes cached processing and is not a cold-prefill measurement. Verification results are transcribed from the run report and were not rerun during archival.

Configuration

The model, serving engine and agent used for this execution.

Recorded configuration and setup details
FieldValueDetail
Model · primaryQwen 3.8 Flash Next · primaryEXL3 2.625 bpw
RuntimeSushi 1.1.0inference engine and exact build
HarnessPi coding agentthe agent or client that drove the run
HardwareApple M5 Pro · 64 GB unified memoryhardware recorded for this execution
WorkloadDigger Arcade · revision 1Interactive coding-agent session; this is not directly comparable with fixed task suites or other challenge prompts.
Repetitions1executions recorded for this workload; one means an indicative result, not an estimate

Inference measurements

Engine-side rates for this run. Each figure states its own statistic; figures from different runs are not interchangeable.

Inference measurements: recorded value and measurement definition
MetricValueDefinition
Decode · per-request median37.2 tok/smedian · n=244
Decode · output-weighted34.62 tok/soutput-token-weighted mean · n=244
Prefill · median419 tok/smedian; includes cached processing · n=244
MTP acceptance69.03 %aggregate · n=117057 · 80,808 accepted out of 117,057 proposed tokens.

Agent session counters

Agent-wide usage totals. These include reasoning, tool calls and waiting, and are not model decode speed.

Agent session counters: recorded value and measurement definition
MetricValueDefinition
Session elapsed161.7 minfirst instruction to final response · n=1
Model requests244 requeststotal · n=1
Tool calls259 callstotal · n=1
Context compactions3 compactionstotal · n=1

Context and token counters

Token totals as reported by the harness or engine. Cached and cumulative figures are not additive with fresh input.

Context and token counters: recorded value and measurement definition
MetricValueDefinition
Maximum prompt context113,993 tokensmaximum · n=1

Recorded check counters

Counts from the checks recorded with this run.

Recorded check counters: recorded value and measurement definition
MetricValueDefinition
Self-tests passed22 teststotal · n=1
Request records & provenance

244 matched requests in run order, paired by prompt/output token counts. Contains token counts, rates and MTP counters only; raw text, timestamps and internal log identifiers are excluded.

Run ID: 2026-10-01-qwen38-flash-next-sushi-digger-arcade

One execution, with checks transcribed from the retained record. A completed session is not a quality score. Measurement method · All runs