Lab study note from the internal benches record (page last-modified 2026-09-12). Not live Oct 1 telemetry.
The first same-node, same-day A/B of the two coders, one resident at a time. The July 23 promotion of Laguna had been made on a single axis — code score — and every other axis favoured the incumbent. On this day the code score reversed too.
Measured (Laguna S 2.1 vs Qwen3-Coder-Next)
- devcode: 87.2% vs 90.9% (Coder-Next +3.7)
- Same-suite wall: 435.7 s vs 82 s (5.3×)
- devtool: 75.0% vs 66.7% — Laguna’s one durable edge
- c1: 17.7 vs 52.7 tok/s (2.98×)
- c2 / c4: 33.3 / 55.2 vs 76.2 / 76.0 — Coder-Next scales, Laguna flattens
- Resident footprint: 101 GiB vs 53.9 GiB (47 GiB reclaimed)
- Cold start: 8–15 min vs ~90 s
Verdict
- Keep coder: Qwen3-Coder-Next restored as the primary lane at 2 × 262,144.
- Specialist: Laguna S 2.1 retained on demand for tool-calling and verified 257K retrieval. Swaps with
coder, so only one large coding model is resident. (Retired as a named lane four days later, July 30.) - Promotion criteria corrected: devcode on this model spanned 83.6–92.1 — a ~9-point spread. Speed, scaling, and memory now carry the weight.
Ops after the revert
507 coder requests, 0 errors, 59.3 tok/s average, longest turn 123 s. Independent sparkrun comparison ranked Coder-Next first of ~30 Spark configurations (0.74 lm-eval mean, HumanEval 0.71 vs Laguna 0.37).
Prompt-speed observability (same day)
The dashboard had been recording coder prompt speed as unknown or worse: 23 of 24 stored samples were negative (min −121,862, max 46,591,011 tok/s), which flattened the prompt histogram into two of fourteen bins. Cause: a metrics shim synthesized timings for engines that omit llama.cpp’s timings block, then shadowed real llama.cpp measurements. After the shim left the coder path: 0 negatives, realistic band 13–709, and an extra proxy hop on an identical 19-token prompt fell 2,930 ms → 1,342 ms. The −1.0 sentinel (not measured) is preserved. Not live Oct 1 telemetry.