Skip to content
Model Pareto

Mistral Medium 3.5

Mistral AIOpen weightsmistral.ai ↗
Compare with nearest rivalsCompare with…
Input
$1.50/M tok
Output
$7.50/M tok
Blended
$3.00/M tok · 3:1
Speed
149tok/s
Context
256Ktokens

Open weights (modified MIT).

Rankings

Self-hostingEstimated

How we estimate →

What it would cost to run these open weights yourself on rented GPUs, compared with the API price above.

Hardware
4× H100 80GB
FP8 weights
Throughput
~2,947 tok/s
many requests batched
Price
$0.54–5.20 /M tok
busy → light use
On your own machine
Mac Studio M5 Max 128GB (int4, ~7 tok/s single-stream)
single consumer GPU or Mac
Assumptions (5)
  • FP8 weights (128B params) + 25% KV-cache headroom ≈ 160 GB
  • 4× H100 80GB at $2.69–$6.88/GPU-hour on-demand (2026-09-24)
  • ~2,947 output tok/s aggregate at batch 86 (bandwidth-bound)
  • Blended 3:1 input:output; prefill ~14,611 tok/s
  • Low = 75% utilization at the low GPU price; high = 20% at the high price

Benchmark scores

~ italic, dashed = no published score yet, estimated from related benchmarks.

Coding

DeepSWE v1.1Estimated
~#28 of 31 (estimated)~48.5%
  1. #1DeepSeek V4.1 Flash74.2%
  2. #2Grok 4.772.6%
  3. #27Qwen3.8 Max (0902)51.0%
  4. ~#28Mistral Medium 3.5Estimated48.5%
  5. #28Qwen3.8 27B42.2%
No published score — estimated from related benchmarks
LiveCodeBenchEstimated
~#8 of 20 (estimated)~66.2%
  1. #1Qwen3.8-Omni-Flash92.6%
  2. #2Qwen3.8 Flash-Next91.9%
  3. #7gpt-oss-20b77.7%
  4. ~#8Mistral Medium 3.5Estimated66.2%
  5. #8Mistral Small 464.0%
No published score — estimated from related benchmarks
AA Coding Agent IndexEstimated
~last of 15 (estimated)below measured range (<41.1)
  1. #1Claude Opus 5.566.0
  2. #2Claude Fable 5.162.2
  3. #14GPT-6 Luna41.1
  4. ~#15Mistral Medium 3.5Estimated<41.1
No published score — estimated from related benchmarks

Writing & chat

MMMLUEstimated
~#3 of 5 (estimated)~85.1%
  1. #1Gemini 3.1 Pro92.6%
  2. #2Gemma 4 31B88.4%
  3. ~#3Mistral Medium 3.5Estimated85.1%
  4. #3Claude Haiku 4.583.0%
No published score — estimated from related benchmarks
LMArena Text, Non-English (Elo)Verified
#34 of 531406 Elo
  1. #1Claude Opus 5.51501
  2. #2Claude Fable 5.1Few votes1496
  3. #33MiMo-V2.51411
  4. #34Mistral Medium 3.51406
  5. #35Nemotron 3 Ultra1405
lmarena.ai · 2026-09-24
LMArena Text (Elo)Verified
#33 of 531426 Elo
  1. #1Claude Opus 5.51509
  2. #2Claude Fable 5.11501
  3. #32MiMo-V2.51434
  4. #33Mistral Medium 3.51426
  5. #33Nemotron 3 Ultra1426
lmarena.ai · 2026-09-24

Vision

MMMUEstimated
~#2 of 3 (estimated)~71.3%
  1. #1Claude Haiku 4.573.2%
  2. ~#2Mistral Medium 3.5Estimated71.3%
  3. #2Llama 4 Maverick69.4%
No published score — estimated from related benchmarks
CharXiv ReasoningEstimated
~last of 9 (estimated)below measured range (<74.5%)
  1. #1Gemini 3.8 Flash86.2%
  2. #2Kimi K384.8%
  3. #8Gemini 3.5 Flash-Lite74.5%
  4. ~#9Mistral Medium 3.5Estimated<74.5%
No published score — estimated from related benchmarks
OmniDocBench v1.5Estimated
~#5 of 8 (estimated)~80.4%
  1. #1MiniMax-M391.6%
  2. #2Kimi K391.1%
  3. #4Gemini 3.1 Pro85.3%
  4. ~#5Mistral Medium 3.5Estimated80.4%
  5. #5Claude Haiku 4.579.6%
No published score — estimated from related benchmarks
ChartographyEstimated
~last of 23 (estimated)below measured range (<9.0%)
  1. #1GPT-6 Astra71.0%
  2. #2Claude Opus 5.566.3%
  3. #22Mistral Large 39.0%
  4. ~#23Mistral Medium 3.5Estimated<9.0%
No published score — estimated from related benchmarks

Hard reasoning

Agents

OSWorld-VerifiedEstimated
~#11 of 12 (estimated)~63.0%
  1. #1Kimi K384.8%
  2. #2Qwen3.8 27B84.3%
  3. #10Muse Glimmer65.9%
  4. ~#11Mistral Medium 3.5Estimated63.0%
  5. #11Claude Haiku 4.550.7%
No published score — estimated from related benchmarks
OSWorld 2.0Estimated
~last of 5 (estimated)below measured range (<47.5%)
  1. #1GLM-5.3 Flash59.1%
  2. #2Kimi K358.3%
  3. #4GPT-5.547.5%
  4. ~#5Mistral Medium 3.5Estimated<47.5%
No published score — estimated from related benchmarks