Spark Bench

Qwen3.8-Flash-Next-NVFP4 MiaAI vLLM two-Spark baseline

2× DGX Spark · vLLM ·

Tested configuration

Hardware
2x NVIDIA DGX Spark (128GB each)
Serving runtime
vLLM
Runtime version or build
vLLM 0.1.dev20073+g8e685d198, MTP speculative decoding with 3 draft tokens · vllm/vllm-openai:qwen38-flash-next
Weight quantization or precision
NVFP4
Benchmark date
Recipe credit
MiaAI-Lab Qwen dual-Spark recipeBy MiaAI-Lab169fbad266f2791335a3102f0d3d625e7c295563

Decode sweep

~256 input / 512 output tokens per request. Output throughput is aggregate across concurrent requests. TTFT means time to first token.

ConcurrencyOutput tok/sTTFT p95 (s)
148.930.43
283.200.87
4134.621.22
8206.781.18
12209.1219.13
16208.1720.96

Prefill and context

Configured request window
1,000,000 tokens
Longest tested prompt
245,760 target input tokens
Validated retrieval
≈240K input tokens · passkey passed

Input throughput uses full request wall time. The passkey measures retrieval from one long prompt.

Workload (c1)Input tok/sTTFT p95 (s)
4,096 input tokens1,312.801.88
32,768 input tokens2,399.4812.50
131,072 input tokens2,380.2353.85
245,760 input tokensPasskey prompt2,069.12117.30

Sustained load

20-minute soak at concurrency 8 · ~1024 input / 512 output tokens per request.

Aggregate throughput
197.71 output tok/s
TTFT p95
1.19 s
Completed requests
469
Request errors
0

Serving regression checks 13/13 passed

Tool-use evaluation

Unavailable · no published tool-eval result for this configuration.

Other configurations for Qwen3.8-Flash-Next NVFP4