Aider polyglot · complete 225-task run
Qwen3.8-27B · NVFP4 + DFlash2
NVIDIA DGX Spark
- within two tries
- 49.8%
- first try
- 9.3%
- tasks recorded
- 225
All measurements & context
- within two tries
- 49.8 %
- first try
- 9.3 %
- tasks recorded
- 225
- suite tasks
- 225
- first try passed
- 21
- within two tries passed
- 112
- test timeouts
- 2
- malformed response counter
- 0
- context exhaustion counter
- 0
- request error output counter
- 0
- cpp tasks recorded
- 26
- cpp first try passed
- 2
- cpp within two tries passed
- 19
- go tasks recorded
- 39
- go first try passed
- 5
- go within two tries passed
- 19
- java tasks recorded
- 47
- java first try passed
- 1
- java within two tries passed
- 21
- javascript tasks recorded
- 49
- javascript first try passed
- 3
- javascript within two tries passed
- 26
- python tasks recorded
- 34
- python first try passed
- 4
- python within two tries passed
- 14
- rust tasks recorded
- 30
- rust first try passed
- 6
- rust within two tries passed
- 13
Measured full recorded run: 21 first-try passes and 112 passes within two tries across all 225 exercises. EQ-Bench long-form generation for this arm was also recorded as completed with judging skipped; it provides no writing-quality score.
Protocol: 225 Exercism tasks across six languages; whole-file editing; temperature 0; one worker; up to two tries with test feedback. Thinking off. Run recipe specifies 65536 context; metadata lists 262144 input and 32768 output. Per-language pass counts are preserved.
Limits: Effective chat-history cap is not independently frozen; earlier notes differ. Harness context-exhaustion, malformed-response and request-error-output counters are event counters, not counts of distinct failed tasks or HTTP requests. One local run, without repeat spread or a matched completed Flash result.
Source: Aggregated retained per-exercise Aider result files and local run recipe. Run start September 26; archive reviewed October 10, 2026.
Runtime: SGLang + DFlash2 · Aider whole-file editing
Source record updated 2026-10-10