Compare models
Hard reasoning: quality vs price
Compared models are ringed; the other 179 ranked here are greyed.
Lower price is better. Pareto frontier: Gemma 4 E4B, Sarvam 30B, Qwen3.5 4B, Sarvam 105B, Ling 3.0 Flash, MiMo-V2.5, GPT-6 Luna, Qwen3.8 Flash-Next, GLM-5.3 Flash, MiMo-V2.6-Pro, Muse Spark 1.3, Claude Sonnet 5.5, Claude Opus 5.5. 70 models are not plotted: Motif 3, Nex-N2-Pro, K2 Horizon 375B A23B, A.X-K2, Solar Open2 250B, Xing4.0-29B-A4B, K2 Horizon MoVA 36B A4B, Intern-S2-Preview (35B-A3B), K-EXAONE 2.0 0803, G9v3-39A5B, K2 Horizon 7B, Phi-4-reasoning-plus, EXAONE 4.5 33B, Nanbeige4.1-3B, HyperNova 60B 2605, Nemotron Cascade 2 30B A3B, INTELLECT-3, Apriel-v1.6-15B-Thinker, Command A+, K2 Horizon 3.7B, Ling 3.0 Tiny, K2 Think V2, Step3 VL 10B, DiffusionGemma 26B A4B, K2-V2, North Mini Code, Falcon-H1R-7B, Solar Open 100B, Llama 3.1 Nemotron Ultra 253B v1, MiniCPM5-2B, LongCat Flash Lite, HyperCLOVA X SEED Think (32B), Tri-21B-Think, EXAONE 4.0 32B, Olmo 3.1 32B Think, LFM2.5-2.6B, Devstral 2, LFM2.5-8B-A1B, Olmo 3.1 32B Instruct, Olmo 3 7B Think, NVIDIA Nemotron 3 Nano 4B, Devstral Small 2, Phi-4-mini-flash-reasoning, Falcon-H1-34B-Instruct, Qwen3.5 2B, Hermes 4 - Llama-3.1 70B, LFM2 24B A2B, Exaone 4.0 1.2B, Llama 3.2 Instruct 90B (Vision), Gemma 4 E2B, Molmo2-8B, LFM2.5-1.2B-Thinking, LFM2.5-1.2B-Instruct, MiniCPM5-1B, Jamba 1.7 Large, MiniCPM-V 4.6 1.3B, Kimi Linear 48B A3B Instruct, Granite 4.0 Micro, Jamba Reasoning 3B, Jamba 1.7 Mini, Phi-4 Multimodal Instruct, Tiny Aya Global, LFM2.5-VL-1.6B, Granite 4.0 H 350M, K2 Horizon 0.9B, Qwen3.5 0.8B, Granite 4.0 350M, Granite 4.0 H 1B, Molmo 7B-D, Gemma 3 270M.
70 models with no price data — shown in the strip at the left edge
Motif 3, Nex-N2-Pro, K2 Horizon 375B A23B, A.X-K2, Solar Open2 250B, Xing4.0-29B-A4B, K2 Horizon MoVA 36B A4B, Intern-S2-Preview (35B-A3B), K-EXAONE 2.0 0803, G9v3-39A5B, K2 Horizon 7B, Phi-4-reasoning-plus, EXAONE 4.5 33B, Nanbeige4.1-3B, HyperNova 60B 2605, Nemotron Cascade 2 30B A3B, INTELLECT-3, Apriel-v1.6-15B-Thinker, Command A+, K2 Horizon 3.7B, Ling 3.0 Tiny, K2 Think V2, Step3 VL 10B, DiffusionGemma 26B A4B, K2-V2, North Mini Code, Falcon-H1R-7B, Solar Open 100B, Llama 3.1 Nemotron Ultra 253B v1, MiniCPM5-2B, LongCat Flash Lite, HyperCLOVA X SEED Think (32B), Tri-21B-Think, EXAONE 4.0 32B, Olmo 3.1 32B Think, LFM2.5-2.6B, Devstral 2, LFM2.5-8B-A1B, Olmo 3.1 32B Instruct, Olmo 3 7B Think, NVIDIA Nemotron 3 Nano 4B, Devstral Small 2, Phi-4-mini-flash-reasoning, Falcon-H1-34B-Instruct, Qwen3.5 2B, Hermes 4 - Llama-3.1 70B, LFM2 24B A2B, Exaone 4.0 1.2B, Llama 3.2 Instruct 90B (Vision), Gemma 4 E2B, Molmo2-8B, LFM2.5-1.2B-Thinking, LFM2.5-1.2B-Instruct, MiniCPM5-1B, Jamba 1.7 Large, MiniCPM-V 4.6 1.3B, Kimi Linear 48B A3B Instruct, Granite 4.0 Micro, Jamba Reasoning 3B, Jamba 1.7 Mini, Phi-4 Multimodal Instruct, Tiny Aya Global, LFM2.5-VL-1.6B, Granite 4.0 H 350M, K2 Horizon 0.9B, Qwen3.5 0.8B, Granite 4.0 350M, Granite 4.0 H 1B, Molmo 7B-D, Gemma 3 270M
- Best-value frontier (nothing is both cheaper and better)
- Evidencestrong → weak
- Estimated from other categories
- Hover a dot for details · click a lab to highlight it
- Qwen3.5 4B
- Quality
- 35.5
- Rank
- #103/182
- Price
- $0.06/M tok
- Speed
- 23tok/s
In$0.03▾Out$0.15▾/M tokvs Gemma 4 31B: −24.1 quality · 0.29× price
- Nemotron 3 Ultra
- Quality
- 58.9
- Rank
- #48/182
- Price
- $1.07/M tok
- Speed
- 215tok/s
In$0.60Out$2.50/M tokvs Gemma 4 31B: −0.7 quality · 5.2× price
- Gemma 4 31B
- Quality
- 59.6
- Rank
- #47/182
- Price
- $0.21/M tok
- Speed
- 35tok/s
In$0.14Out$0.40/M tokvs Nemotron 3 Ultra: +0.7 quality · 0.19× price
Overview
Quality by category
0–100 within each category (100 = best tracked model). Rank is among all models ranked there. Click a row to focus it.
Hard reasoning benchmarks
Rank among models with a published score, and the leaderboard around each model. ~ italic = no published score, estimated from related benchmarks.
Benchmarks in other categories (4)· Coding, Writing & chat, Vision, Agents
Coding benchmarks
Rank among models with a published score, and the leaderboard around each model. ~ italic = no published score, estimated from related benchmarks.
Writing & chat benchmarks
Rank among models with a published score, and the leaderboard around each model. ~ italic = no published score, estimated from related benchmarks.
Vision benchmarks
Rank among models with a published score, and the leaderboard around each model. ~ italic = no published score, estimated from related benchmarks.
Agents benchmarks
Rank among models with a published score, and the leaderboard around each model. ~ italic = no published score, estimated from related benchmarks.