Skip to content
Model Pareto

Qwen3.8 2.4T A95B

Alibaba QwenOpen weightshuggingface.co ↗
Input
$2.00/M tok
Output
$6.00/M tok
Blended
$3.00/M tok · 3:1
Speed
38tok/s
Context
262Ktokens

Open-weights checkpoint behind Qwen3.8 Max; priced at Qwen3.8 Max API rates.

Rankings

Self-hostingEstimated

How we estimate →

What it would cost to run these open weights yourself on rented GPUs, compared with the API price above.

Hardware
24× B200 180GB
FP8 weights
Throughput
~27,655 tok/s
many requests batched
Price
$0.66–5.85 /M tok
busy → light use
On your own machine
Too large
needs data-center GPUs
Assumptions (5)
  • FP8 weights (2400B params, 95B active per token) + 25% KV-cache headroom ≈ 3000 GB
  • 24× B200 180GB at $5.98–$14.24/GPU-hour on-demand (2026-09-24)
  • ~27,655 output tok/s aggregate at batch 931 (bandwidth-bound); MoE compute scales with active params
  • Blended 3:1 input:output; prefill ~228,292 tok/s
  • Low = 75% utilization at the low GPU price; high = 20% at the high price

Benchmark scores

~ italic, dashed = no published score yet, estimated from related benchmarks.

Coding

Not comparable across labs (1)

Kept for reference, not counted in rankings: these use a lab-specific task set, answer key or scoring, so scores can't be compared fairly across labs. Only published scores are shown.

Writing & chat

Hard reasoning

Agents