Archived coder gate · baseline-lightning-v029
Nemotron-3.5-Lightning 30B-A3B · NVFP4 + DSpark
Historical lab pool
- framework
- 80.3%
- developer tools
- 75%
- single stream
- 77.6tok/s
All measurements & context
- framework
- 80.3 %
- developer tools
- 75 %
- single stream
- 77.6 tok/s
- 2-stream aggregate
- 120.4 tok/s
- 4-stream aggregate
- 169 tok/s
- four request mean decode
- 45.8 tok/s
- framework wall
- 42 s
- gate first response
- 0 s
- bash framework
- 88.9 %
- nuxt framework
- 85.7 %
- repo framework
- 75 %
- swift framework
- 74.1 %
- tailwind framework
- 44.4 %
- vue framework
- 100 %
Measured historical gate. Clean September rebaseline. Historical agent, superseded later.
Protocol: Eight framework prompts scored by regex, twelve developer tool scenarios, and warm lighthouse-prose concurrency waves. Defaults: framework temperature 0.2 / output 4096; tools 0.1 / 1024; concurrency 0.7 / 512; thinking off. c1/c2/c4 divide total completion positions by whole-wave wall time. Mean per-request decode excludes each request’s TTFT. Gate first response is the short ping, not an independently measured model load time.
Limits: No code compilation or actual tool execution. One report does not establish repeat spread or context qualification. Different slot counts, runtime revisions and dates limit cross-engine comparisons.
Source: Retained numeric coder-gate summary, 2026-09-12; reviewed October 10, 2026.
Runtime: vLLM 0.29.0
Source record updated 2026-10-10