Archived coder gate · baseline-qwen38-sglang-v255
Qwen3.8-27B · NVFP4 + DFlash2
Historical lab pool
- framework
- 85.9%
- developer tools
- 75%
- single stream
- 19.6tok/s
All measurements & context
- framework
- 85.9 %
- developer tools
- 75 %
- single stream
- 19.6 tok/s
- 2-stream aggregate
- 31.5 tok/s
- 4-stream aggregate
- 42.7 tok/s
- four request mean decode
- 22.6 tok/s
- framework wall
- 154 s
- gate first response
- 1 s
- bash framework
- 77.8 %
- nuxt framework
- 100 %
- repo framework
- 100 %
- swift framework
- 74.1 %
- tailwind framework
- 77.8 %
- vue framework
- 91.7 %
Measured historical gate. Clean September rebaseline. Historical coder, superseded later.
Protocol: Eight framework prompts scored by regex, twelve developer tool scenarios, and warm lighthouse-prose concurrency waves. Defaults: framework temperature 0.2 / output 4096; tools 0.1 / 1024; concurrency 0.7 / 512; thinking off. c1/c2/c4 divide total completion positions by whole-wave wall time. Mean per-request decode excludes each request’s TTFT. Gate first response is the short ping, not an independently measured model load time.
Limits: No code compilation or actual tool execution. One report does not establish repeat spread or context qualification. Different slot counts, runtime revisions and dates limit cross-engine comparisons.
Source: Retained numeric coder-gate summary, 2026-09-12; reviewed October 10, 2026.
Runtime: SGLang Qwen3.8 image · retained gate revision
Source record updated 2026-10-10