Skip to content

Benchmarks / evidence with context

Useful numbers. Honest boundaries.

Measured studies, operations records, and catalog estimates are separate kinds of evidence. Explore the original dates, runtimes, units, and decisions behind the configuration.

39 MEASURED STUDIES3 OPS RECORDS3 CATALOG ESTIMATESDOWNLOAD ALL RECORDS ↓

GB10 pair / Reviewed Oct 23, 2026

DeepSeek is serving. The coding panel is a tie.

Normal DeepSeek V4.1 Flash 1017 runs through TensorFold TP2 on the DGX Spark and ASUS GX10. The matched GLM comparison, short serving probes and memory observation answer different questions.

Shared inference slots
4

Coder, scout and vision share this capacity. Studio agent and embeddings keep independent routes.

Configured context
524,288

A serving limit. Local full-window retrieval and concurrent long-context capacity remain unqualified.

Initial memory minima / GiB
4.93 / 6.55

Head / worker available memory across one hour, 1,800 samples each. A bounded observation; guards remain active.

October 22–23 · Same frozen primary Hermes protocol, temperature 0.2, thinking off, 4,096 output allowance. Coding handoffs and diagnostic decisions keep separate denominators.
Model / dateRoutine codingHard codingDefective reviewOther controls
GLM · abliterated1 / 10 / 3Incorrect approvalAdmission 1 / 1
Healthy review 1 / 1
DeepSeek · normal1 / 10 / 3Correct rejectionAdmission 1 / 1
Healthy review 1 / 1

One routine task, three hard tasks, one visit each, one harness. Behavior, scope, report, exact identity and cleanup are required. This local panel is not an official SWE-bench score. Later production high-reasoning tuning is separate; no difficult-coding advantage was demonstrated.

Historical / September Studio evaluation

Speed is only one axis.

Protocol & limitations ↗

M5 Max · 40 GPU cores · 48 GB · Sep 22–23, 2026 · thinking off. Lightning here is the evaluated Nemotron artifact. The current SuperQwen alias has no score in this chart.

HumanEval / % ↑

050100080160

Code decode / tok/s →

Coding fallback / MLX 4-bit

95.1%

HumanEval · 156 / 164 tasks passed

All 164 original tasks, one greedy chat sample, original executable tests, no repair or retries. Chat-adapted pass@1; training contamination is possible. Gemma was a writing-role evaluation and did not run this suite.

Speed: median of three short 512-output code probes on a loaded backend. Timing and quality use different prompts; this is not full-task wall time.

See the experiments in the visual lab.Speculation, concurrency, promotion reversals, image budgets, and quality gates.

Explore the study records

3 OF 45 RECORDS

The evidence atlas / 3 records

Every study keeps its date.

Select a date to inspect its records. The dots count records, not performance.

MEASUREDOPERATIONSCATALOG
Measured study

October short-prompt runtime probe · Qwen / TensorFold

Qwen3.8-Flash-Next · NVFP4

NVIDIA DGX Spark

code single stream
80.09tok/s
prose single stream
50.26tok/s
prefill ttft
2.108s
All measurements & context
code single stream
80.09 tok/s
prose single stream
50.26 tok/s
prefill ttft
2.108 s
code 4-request mean
53.7 tok/s
code 8-request mean
36.51 tok/s
prose 4-request mean
39.36 tok/s
prose 8-request mean
31.8 tok/s
code 4-request rate sum
214.78 tok/s
code 8-request rate sum
292.04 tok/s
prose 4-request rate sum
157.46 tok/s
prose 8-request rate sum
254.43 tok/s
code single stream ttft
0.119 s
code single stream completion tokens
228
prefill input tokens
6,033
wave requests
26
wave successes
26
prefill requests
1
http errors
0

Measured historical speed probe on the DGX Spark + ASUS GX10 pair. Every wave request and the separate prefill probe returned HTTP 200. Code was not executed and prose was not scored. A speed probe is not a model promotion or full-context qualification.

Protocol: One prose prompt and one Python merge-function prompt; one wave each at concurrency 1, 4 and 8. Temperature 0, requested reasoning_effort medium, streaming with usage, wave output cap 320. TTFT includes first content or reasoning. Per-request decode = reported completion positions / elapsed time after first output. Concurrent means average these request rates; rate sums add them and are not wave-wall throughput. The separate ~6K input probe used output cap 16.

Limits: One wave per workload/concurrency, no repeat spread. Dates, model tokenizers and output lengths differ; exact runtime revision, effective thinking policy, cache state and external contention were not independently frozen. The prefill probe does not qualify 262K retrieval. No executed correctness, tool suite, or writing-quality result.

Source: Retained lab speed report · October 9, 22:56:32–22:57:14 CDT

Runtime: TensorFold two-node TP2; exact probe revision not retained
Source record updated 2026-10-10

Read the decision ↗
Measured study

October short-prompt runtime probe · GLM / TensorFold

GLM-5.3-Flash · EXL3

NVIDIA DGX Spark

code single stream
97.59tok/s
prose single stream
43.14tok/s
prefill ttft
8.062s
All measurements & context
code single stream
97.59 tok/s
prose single stream
43.14 tok/s
prefill ttft
8.062 s
code 4-request mean
78.9 tok/s
code 8-request mean
46.2 tok/s
prose 4-request mean
28.06 tok/s
prose 8-request mean
23.49 tok/s
code 4-request rate sum
315.6 tok/s
code 8-request rate sum
369.61 tok/s
prose 4-request rate sum
112.25 tok/s
prose 8-request rate sum
187.92 tok/s
code single stream ttft
0.181 s
code single stream completion tokens
207
prefill input tokens
6,032
wave requests
26
wave successes
26
prefill requests
1
http errors
0

Measured historical speed probe on the DGX Spark + ASUS GX10 pair. Every wave request and the separate prefill probe returned HTTP 200. Code was not executed and prose was not scored. A speed probe is not a model promotion or full-context qualification.

Protocol: One prose prompt and one Python merge-function prompt; one wave each at concurrency 1, 4 and 8. Temperature 0, requested reasoning_effort medium, streaming with usage, wave output cap 320. TTFT includes first content or reasoning. Per-request decode = reported completion positions / elapsed time after first output. Concurrent means average these request rates; rate sums add them and are not wave-wall throughput. The separate ~6K input probe used output cap 16.

Limits: One wave per workload/concurrency, no repeat spread. Dates, model tokenizers and output lengths differ; exact runtime revision, effective thinking policy, cache state and external contention were not independently frozen. The prefill probe does not qualify 262K retrieval. No executed correctness, tool suite, or writing-quality result.

Source: Retained lab speed report · October 5, 18:04:27–18:05:20 CDT

Runtime: TensorFold two-node TP2; exact probe revision not retained
Source record updated 2026-10-10

Read the decision ↗
Measured study

October short-prompt runtime probe · Qwen / vLLM

Qwen3.8-Flash-Next · NVFP4

NVIDIA DGX Spark

code single stream
67.25tok/s
prose single stream
44.79tok/s
prefill ttft
1.851s
All measurements & context
code single stream
67.25 tok/s
prose single stream
44.79 tok/s
prefill ttft
1.851 s
code 4-request mean
53.48 tok/s
code 8-request mean
45.47 tok/s
prose 4-request mean
31.33 tok/s
prose 8-request mean
26.62 tok/s
code 4-request rate sum
213.91 tok/s
code 8-request rate sum
363.78 tok/s
prose 4-request rate sum
125.32 tok/s
prose 8-request rate sum
213 tok/s
code single stream ttft
0.317 s
code single stream completion tokens
244
prefill input tokens
6,031
wave requests
26
wave successes
26
prefill requests
1
http errors
0

Measured historical speed probe on the DGX Spark + ASUS GX10 pair. Every wave request and the separate prefill probe returned HTTP 200. Code was not executed and prose was not scored. A speed probe is not a model promotion or full-context qualification.

Protocol: One prose prompt and one Python merge-function prompt; one wave each at concurrency 1, 4 and 8. Temperature 0, requested reasoning_effort medium, streaming with usage, wave output cap 320. TTFT includes first content or reasoning. Per-request decode = reported completion positions / elapsed time after first output. Concurrent means average these request rates; rate sums add them and are not wave-wall throughput. The separate ~6K input probe used output cap 16.

Limits: One wave per workload/concurrency, no repeat spread. Dates, model tokenizers and output lengths differ; exact runtime revision, effective thinking policy, cache state and external contention were not independently frozen. The prefill probe does not qualify 262K retrieval. No executed correctness, tool suite, or writing-quality result.

Source: Retained lab speed report · October 5, 16:41:01–16:41:49 CDT

Runtime: vLLM two-node TP2; exact probe revision not retained
Source record updated 2026-10-10

Read the decision ↗