Local Model Benchmarks

Local test machine: Apple M5 Pro · 64 GB unified memoryRun window 29 September — 18 October 202622 recorded runs

29 September 2026 · Agentic game · browser FPS

Whiteout Protocol · TensorFold 0.3.6.3

Session completed Local run

Completed a separate Whiteout Protocol implementation and build with TensorFold.

Whiteout Protocol TensorFold scene with the weapon, snowy arena and pause prompt visible
Whiteout Protocol · TensorFold build · gameplay capture

What was checked

  • Production build passed; the JavaScript bundle was 623624 bytes and gzip output was 165179 bytes.
  • A 75-second smoke test reported zero console errors.
  • Aim-down-sights self-tests passed at FOV 75, 65, and 55 with zero-pixel offset.
  • Gameplay checks covered deployment, combat, seven kills, wave clear, score tally, wave 2, and restart.
  • Two post-feedback browser runs completed the menu-to-game transition without console errors.

Configuration

The model, serving engine and agent used for this execution.

Recorded configuration and setup details
FieldValueDetail
Model · verifierQwen 3.8 27B · verifier4-bit · 4 bpw
Checkpoint · verifierQwen3.8-27B MLX-Serve 4-bitverifier model artifact
Model · drafterQwen 3.8 27B · drafterQ4 · 4 bpw
RuntimeTensorFold 0.3.6.3 · source commit 1911880inference engine and exact build
HarnessPi coding agentthe agent or client that drove the run
HardwareApple M5 Pro · 64 GB unified memoryhardware recorded for this execution
WorkloadWhiteout Protocol · revision 1Same canonical challenge as the Sushi baseline. This run spanned 2026-09-29 to 2026-09-30 and included a long backend outage.
Context window131,072 tokensmaximum context configured for the serving runtime
Repetitions1executions recorded for this workload; one means an indicative result, not an estimate

Inference measurements

Engine-side rates for this run. Each figure states its own statistic; figures from different runs are not interchangeable.

Inference measurements: recorded value and measurement definition
MetricValueDefinition
Decode · median22.9 tok/smedian · n=273
Decode · 10th percentile17 tok/s10th percentile · n=273
Decode · 90th percentile35.8 tok/s90th percentile · n=273
Decode · peak59.3 tok/speak · n=273
TTFT · cached median7.8 smedian · n=273
TTFT · cached 90th percentile20.9 s90th percentile · n=273
Cold prefill · worst observed218.9 sworst observed · n=1
Peak KV checkpoint6.23 GiBpeak · n=1
Resident model weights20 GiBapproximate · n=1

Agent session counters

Agent-wide usage totals. These include reasoning, tool calls and waiting, and are not model decode speed.

Agent session counters: recorded value and measurement definition
MetricValueDefinition
Session elapsed849.6 minfirst user message to final report; includes outage · n=1
Backend outage428.6 mintotal · n=1
Elapsed excluding outage421.0 mineffective elapsed · n=1
Requests retained after relaunch273 requestspost-relaunch retained · n=1
Backend errors before relaunch4 errorstotal · n=1
Backend errors after relaunch0 errorstotal · n=1
Tool calls368 callstotal · n=1
Context compactions5 compactionstotal · n=1

Context and token counters

Token totals as reported by the harness or engine. Cached and cumulative figures are not additive with fresh input.

Context and token counters: recorded value and measurement definition
MetricValueDefinition
Maximum prompt context114,700 tokensapproximate maximum as reported · n=1

Recorded check counters

Counts from the checks recorded with this run.

Recorded check counters: recorded value and measurement definition
MetricValueDefinition
Smoke test duration75 sduration · n=1
Console errors0 errorssmoke test · n=1
Request records & provenance

The source report retains 273 successful post-relaunch request measurements in aggregate, but the public archive does not contain per-request rows. Original prompt, prompt fingerprint, session transcript, server logs, and local paths are excluded.

Run ID: 2026-09-29-qwen38-27b-tensorfold-whiteout-protocol

One execution, with checks transcribed from the retained record. A completed session is not a quality score. Measurement method · All runs