Aider polyglot · incomplete Flash-Next run
MiaAI Qwen3.8-Flash-Next · NVFP4 (September artifact)
Historical lab pool
- within two tries passed
- 58
- tasks recorded
- 94
- suite tasks
- 225
All measurements & context
- within two tries passed
- 58
- tasks recorded
- 94
- suite tasks
- 225
- tasks unrecorded
- 131
- first try passed
- 28
- test timeouts
- 0
- malformed response counter
- 1
- context exhaustion counter
- 72
- request error output counter
- 73
- cpp tasks recorded
- 12
- cpp first try passed
- 1
- cpp within two tries passed
- 5
- go tasks recorded
- 11
- go first try passed
- 4
- go within two tries passed
- 6
- java tasks recorded
- 22
- java first try passed
- 6
- java within two tries passed
- 15
- javascript tasks recorded
- 24
- javascript first try passed
- 8
- javascript within two tries passed
- 16
- python tasks recorded
- 14
- python first try passed
- 4
- python within two tries passed
- 10
- rust tasks recorded
- 11
- rust first try passed
- 5
- rust within two tries passed
- 6
Measured partial archive: 94/225 task result files, 28 first-try passes and 58 passes within two tries among the recorded tasks. No final suite percentage or winner is reported. The missing 131 tasks are unrecorded, not imputed failures. This is the September MiaAI artifact, not the October NVIDIA serving artifact.
Protocol: 225 Exercism tasks across six languages; whole-file editing; temperature 0; one worker; up to two tries with test feedback. Thinking on. Run recipe specifies 65536 context; metadata lists 262144 input and 32768 output. Per-language pass counts are preserved.
Limits: Effective chat-history cap is not independently frozen; earlier notes differ. Harness context-exhaustion, malformed-response and request-error-output counters are event counters, not counts of distinct failed tasks or HTTP requests. Incomplete run with different artifact, thinking policy and infrastructure; observed pass counts cannot support a final 225-task rate.
Source: Aggregated retained per-exercise Aider result files and local run recipe. Run start September 26; archive reviewed October 10, 2026.
Runtime: vLLM two-GB10 · Aider whole-file editing
Source record updated 2026-10-10