Skip to content
Model Pareto

Mistral Small 4

Mistral AIOpen weightsmistral.ai ↗
Input
$0.15/M tok
Output
$0.60/M tok
Blended
$0.262/M tok · 3:1
Speed
170tok/s
Context
256Ktokens

Open weights (Apache 2.0).

Rankings

Self-hostingEstimated

How we estimate →

What it would cost to run these open weights yourself on rented GPUs, compared with the API price above.

Hardware
2× H200 141GB
FP8 weights
Throughput
~8,963 tok/s
many requests batched
Price
$0.088–0.73 /M tok
busy → light use
On your own machine
Mac Studio M5 Max 128GB (int4, ~130 tok/s single-stream)
single consumer GPU or Mac
Assumptions (5)
  • FP8 weights (119B params, 6.5B active per token) + 25% KV-cache headroom ≈ 149 GB
  • 2× H200 141GB at $3.59–$7.91/GPU-hour on-demand (2026-09-24)
  • ~8,963 output tok/s aggregate at batch 322 (bandwidth-bound); MoE compute scales with active params
  • Blended 3:1 input:output; prefill ~143,858 tok/s
  • Low = 75% utilization at the low GPU price; high = 20% at the high price

Benchmark scores

~ italic, dashed = no published score yet, estimated from related benchmarks.

Coding

Writing & chat

Vision

Hard reasoning

Agents