Matched local repository handoff panel · coding and review controls
DeepSeek V4.1 Flash 1017 · EXL3 · normal
NVIDIA DGX Spark
- routine passed
- 1
- routine tasks
- 1
- hard passed
- 0
All measurements & context
- routine passed
- 1
- routine tasks
- 1
- hard passed
- 0
- hard tasks
- 3
- defective review correct
- 1
- scope admission correct
- 1
- healthy review correct
- 1
- routine wall
- 74.698 s
- menu behavior wall
- 350.188 s
- strict types wall
- 412.824 s
- socket repair wall
- 814.588 s
Measured local portfolio panel. Routine coding and hard coding have separate denominators; admission, defective-change review and healthy-change review are separate diagnostic controls. Both models tied on coding; no difficult-coding advantage was demonstrated.
Protocol: Same frozen tasks, sources, sampling, budgets and independent acceptance gates. Temperature 0.2, thinking disabled, 4,096 output allowance per request. Routine: 360 seconds / 32 requests; hard visits: 1,440 seconds / 96 requests including repairs and reporting. Acceptance requires behavior, allowed scope, structured report, exact native identity and verified cleanup. Each control is one decision, encoded 1 for correct and 0 for incorrect. One visit per case; the healthy-menu positive control is reported separately from the six-case panel.
Limits: One primary harness, one routine coding task, three hard coding tasks, and no statistical ranking. This is not an official SWE-bench Verified result. Wall time includes tools and cache effects. Normal DeepSeek is compared with the previously serving abliterated GLM checkpoint. Later high-reasoning production tuning and historical mixed-revision controls are not pooled into this comparison. Public commands passing alone do not override behavior or scope failures.
Source: Dated frozen primary Hermes comparison receipts · October 22–23, 2026; native identities and source fingerprints checked
Runtime: TensorFold TP2 · primary Hermes harness · frozen completion-v11 protocol
Source record updated 2026-10-23