Agents models ranked by quality, price and speed
Quality vs price
8 models on the frontier — nothing else is both cheaper and better.
Lower price is better. Pareto frontier: Granite 4.2 3B, Qwen3.5 4B, Ling-3.0-flash-VL, GPT-6 Luna, Qwen3.8 Flash-Next, GLM-5.3 Flash, Muse Spark 1.3, Claude Opus 5.5. 1 models are not plotted: Muse Wonder Full.
1 model with no price data — shown in the strip at the left edge
Muse Wonder Full
- Best-value frontier (nothing is both cheaper and better) · strong + medium evidence; weak shown but excluded
- Evidencestrong → weak
- Estimated from other categories
- Estimated (price or speed)
- Hover a dot for details · click a lab to highlight it
Ranking · 143 models
Price $/M tokens (blended 3:1) · Speed output tokens/s
| Select to compare | Source | Details | ||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| 1 | Claude Opus 5.5Frontier | Anthropic | 97.7±5.0 | $8.00$10/task | 92 | 2/7 benchmarks measured | Verified | |||
| 2 | Meta | 97.6±5.1 | — | — | 2/7 benchmarks measured | Verified | ||||
| 3 | Anthropic | 97.6±5.1 | $16.0$27/task | est.~48 | 2/7 benchmarks measured | Verified | ||||
| 4 | Meta | 91.5±7.8 | $8.00$7.0/task | 101 | 2/7 benchmarks measured | Verified | ||||
| 5 | Anthropic | 88.2±5.9 | $20.0est.~$21/task | 48 | 3/7 benchmarks measured | Verified | ||||
| 6 | GLM-5.3Open | Z.ai (Zhipu) | 85.3±5.9 | $2.15$5.0/task | 80 | 3/7 benchmarks measured | Verified | |||
| 7 | Muse Spark 1.3Frontier | Meta | 85.3±5.9 | $2.00est.~$1.8/task | 124 | 3/7 benchmarks measured | Verified | |||
| 8 | SpaceXAI (xAI) | 84.4±7.8 | $3.00$7.8/task | 76 | 2/7 benchmarks measured | Verified | ||||
| 9 | Anthropic | 83.5±4.6 | $10.0est.~$11/task | 54 | 4/7 benchmarks measured | Mixed | ||||
| 10 | Alibaba Qwen | 83.0±5.9 | $3.00$10/task | 39 | 3/7 benchmarks measured | Verified | ||||
| 11 | Z.ai (Zhipu) | 82.9±5.2 | $0.24est.~$0.21/task | 64 | 4/7 benchmarks measured | Mixed | ||||
| 12 | MiMo-V2.6-ProOpen | Xiaomi MiMo | 82.3±6.4 | $0.54$0.26/task | 49 | 3/7 benchmarks measured | Mixed | |||
| 13 | SpaceXAI (xAI) | 81.6±5.9 | $3.00est.~$2.5/task | 56 | 3/7 benchmarks measured | Verified | ||||
| 14 | Kimi K3Open | Moonshot AI (Kimi) | 81.1±3.5 | $6.00est.~$6.3/task | 37 | 6/7 benchmarks measured | Mixed | |||
| 15 | OpenAI | 81.1±7.8 | $4.00$1.3/task | 53 | 2/7 benchmarks measured | Verified | ||||
| 16 | OpenAI | 80.6±4.6 | $20.0$6.2/task | 52 | 4/7 benchmarks measured | Mixed | ||||
| 17 | Alibaba Qwen | 80.6±5.9 | $3.00est.~$2.5/task | 38 | 3/7 benchmarks measured | Verified | ||||
| 18 | Alibaba Qwen | 79.5±5.9 | $0.23est.~$0.20/task | 54 | 3/7 benchmarks measured | Verified | ||||
| 19 | DeepSeek | 78.5±7.8 | $0.52est.~$0.51/task | 232 | 2/7 benchmarks measured | Verified | ||||
| 20 | NVIDIA | 75.7±10.1 | self-host~$0.30–2.64 | est.~140 | 1/7 benchmarks measured | Lab-reported | ||||
| 21 | Google DeepMind | 74.7±5.9 | $1.50$7.8/task | 129 | 3/7 benchmarks measured | Verified | ||||
| 22 | Step 5 PreviewOpen | StepFun | 74.1±6.3 | $1.43est.~$1.1/task | 85 | 3/7 benchmarks measured | Mixed | |||
| 23 | MiMo-V2.6-FlashOpen | Xiaomi MiMo | 74.1±10.6 | $0.18est.~$0.12/task | 55 | 1/7 benchmarks measured | Lab-reported | |||
| 24 | OpenAI | 73.8±7.8 | $4.00est.~$4.2/task | 92 | 2/7 benchmarks measured | Verified | ||||
| 25 | MiniMax | 73.7±12.5 | $0.26est.~$0.25/task | 87 | 0/7 benchmarks measured | Estimated | ||||
| 26 | Qwen3.8 27BOpen | Alibaba Qwen | 72.8±4.7 | $1.13$3.5/task | 54 | 4/7 benchmarks measured | Mixed | |||
| 27 | Nex-N2.5-ProOpen | Nex AGI | 72.6±8.7 | $0.12est.~$0.10/task | est.~90 | 2/7 benchmarks measured | Lab-reported | |||
| 28 | OpenAI | 70.5±3.2 | $4.50est.~$5.1/task | 104 | 6/7 benchmarks measured | Mixed | ||||
| 29 | Mistral Large 4Open | Mistral AI | 70.2±7.8 | $2.06$2.1/task | est.~91 | 2/7 benchmarks measured | Verified | |||
| 30 | DeepSeek | 69.7±5.9 | $1.98est.~$1.7/task | 97 | 3/7 benchmarks measured | Verified | ||||
| 31 | Shanghai AI Lab (Intern) | 68.7±10.5 | self-host~$0.30–2.69 | est.~81 | 1/7 benchmarks measured | Lab-reported | ||||
| 32 | Muse Spark OpenOpen | Meta | 67.8±10.6 | self-host~$0.30–2.50 | est.~58 | 1/7 benchmarks measured | Lab-reported | |||
| 33 | OpenAI | 67.4±10.0 | $4.81 | 102 | 1/7 benchmarks measured | Verified | ||||
| 34 | OpenAI | 66.4±3.2 | $11.3est.~$13/task | 91 | 7/7 benchmarks measured | Mixed | ||||
| 35 | Reflection AI | 65.3±10.5 | self-host~$0.16–1.46 | est.~86 | 1/7 benchmarks measured | Lab-reported | ||||
| 36 | NVIDIA | 64.9±10.1 | self-host~$0.079–0.70 | est.~180 | 1/7 benchmarks measured | Lab-reported | ||||
| 37 | Anthropic | 64.0±3.8 | $4.00est.~$4.2/task | 58 | 5/7 benchmarks measured | Mixed | ||||
| 38 | GPT-6 LunaFrontier | OpenAI | 63.7±7.8 | $0.20$0.15/task | 132 | 2/7 benchmarks measured | Verified | |||
| 39 | Motif 3Open | Motif Technologies | 63.5±10.0 | self-host~$0.13–1.19 | est.~92 | 1/7 benchmarks measured | Verified | |||
| 40 | MBZUAI Institute of Foundation Models | 55.0±5.9 | self-host~$0.17–1.38 | 124 | 3/7 benchmarks measured | Verified | ||||
| 41 | Google DeepMind | 53.9±3.4 | $4.50est.~$5.1/task | 120 | 5/7 benchmarks measured | Mixed | ||||
| 42 | OpenAI | 53.7±10.0 | $3.50 | 143 | 1/7 benchmarks measured | Verified | ||||
| 43 | Alibaba Qwen | 53.0±10.0 | $1.50 | 108 | 1/7 benchmarks measured | Verified | ||||
| 44 | Nex-N2.5-MiniOpen | Nex AGI | 49.7±8.7 | $0.04est.~$0.04/task | est.~110 | 2/7 benchmarks measured | Lab-reported | |||
| 45 | Amazon Nova | 47.8±7.8 | $3.44 | 120 | 2/7 benchmarks measured | Verified | ||||
| 46 | Ling-2.6-1TOpen | inclusionAI (Ant Group) | 47.1±10.0 | $0.85 | est.~100 | 1/7 benchmarks measured | Verified | |||
| 47 | MiniMax-M3Open | MiniMax | 46.6±3.4 | $0.52est.~$0.51/task | 88 | 5/7 benchmarks measured | Mixed | |||
| 48 | NVIDIA | 46.4±6.9 | self-host~$0.11–0.96 | est.~160 | 3/7 benchmarks measured | Lab-reported | ||||
| 49 | Solar Open2 250BOpen | Upstage | 46.4±10.0 | self-host~$0.12–1.11 | est.~91 | 1/7 benchmarks measured | Verified | |||
| 50 | OpenAI | 46.3±4.3 | $1.69est.~$1.9/task | 217 | 4/7 benchmarks measured | Verified | ||||
| 51 | MBZUAI Institute of Foundation Models | 46.2±5.9 | self-host~$0.053–0.44 | est.~120 | 3/7 benchmarks measured | Verified | ||||
| 52 | Amazon Nova | 45.8±10.0 | $0.85 | est.~170 | 1/7 benchmarks measured | Verified | ||||
| 53 | Ling 3.0 FlashOpen | inclusionAI (Ant Group) | 45.7±10.0 | $0.11est.~$0.09/task | 346 | 1/7 benchmarks measured | Verified | |||
| 54 | Upstage | 45.4±10.1 | $0.52est.~$0.51/task | 93 | 1/7 benchmarks measured | Verified | ||||
| 55 | Apodex | 45.3±5.9 | $0.97est.~$1.3/task | est.~98 | 3/7 benchmarks measured | Verified | ||||
| 56 | NVIDIA | 44.8±6.9 | self-host~$0.11–0.96 | est.~160 | 3/7 benchmarks measured | Lab-reported | ||||
| 57 | Kimi K2.7 CodeOpen | Moonshot AI (Kimi) | 44.7±4.3 | $1.71est.~$1.7/task | 90 | 4/7 benchmarks measured | Verified | |||
| 58 | inclusionAI (Ant Group) | 44.5±5.9 | $0.11est.~$0.09/task | 147 | 3/7 benchmarks measured | Verified | ||||
| 59 | Hy3Open | Tencent Hunyuan | 44.5±4.6 | $0.25est.~$0.24/task | 86 | 4/7 benchmarks measured | Mixed | |||
| 60 | K2-Horizon-32BOpen | MBZUAI Institute of Foundation Models | 43.8±10.2 | self-host~$0.17–1.56 | est.~92 | 1/7 benchmarks measured | Lab-reported | |||
| 61 | Inkling SmallOpen | Thinking Machines Lab | 43.2±10.0 | $0.52est.~$0.51/task | 206 | 1/7 benchmarks measured | Verified | |||
| 62 | Multiverse Computing | 43.0±5.9 | $0.90est.~$0.76/task | 152 | 3/7 benchmarks measured | Verified | ||||
| 64 | G9v3-39A5BOpen | AI9Stars | 42.1±10.1 | self-host~$0.061–0.50 | est.~100 | 1/7 benchmarks measured | Verified | |||
| 65 | Alibaba Qwen | 41.8±4.3 | $0.70est.~$0.68/task | 65 | 4/7 benchmarks measured | Verified | ||||
| 66 | Step 3.7 FlashOpen | StepFun | 41.2±5.9 | $0.44est.~$0.48/task | 137 | 3/7 benchmarks measured | Verified | |||
| 67 | NAVER HyperCLOVA X | 41.2±10.0 | self-host~$0.17–1.50 | est.~82 | 1/7 benchmarks measured | Verified | ||||
| 68 | InklingOpen | Thinking Machines Lab | 41.2±4.6 | $1.76est.~$1.7/task | 184 | 4/7 benchmarks measured | Mixed | |||
| 69 | EXAONE 4.5 33BOpen | LG AI Research (EXAONE) | 40.6±7.8 | self-host~$0.17–1.49 | est.~83 | 2/7 benchmarks measured | Verified | |||
| 70 | Google DeepMind | 40.2±4.7 | $0.85est.~$1.1/task | 351 | 4/7 benchmarks measured | Mixed | ||||
| 71 | ServiceNow | 40.1±10.0 | self-host~$0.12–1.09 | est.~91 | 1/7 benchmarks measured | Verified | ||||
| 72 | K2 Horizon 7BOpen | MBZUAI Institute of Foundation Models | 39.7±5.9 | self-host~$0.083–0.74 | est.~110 | 3/7 benchmarks measured | Verified | |||
| 73 | Nex-N2-ProOpen | Nex AGI | 39.7±4.3 | self-host~$0.20–1.76 | est.~90 | 4/7 benchmarks measured | Verified | |||
| 74 | Tri-21B-ThinkOpen | Trillion Labs | 39.3±10.0 | self-host~$0.16–1.46 | est.~87 | 1/7 benchmarks measured | Verified | |||
| 75 | OpenBMB (MiniCPM) | 39.1±10.0 | self-host~$0.024–0.20 | est.~120 | 1/7 benchmarks measured | Verified | ||||
| 76 | OpenAI | 39.0±4.3 | $0.46est.~$0.53/task | 165 | 4/7 benchmarks measured | Verified | ||||
| 77 | Meituan LongCat | 38.5±10.0 | self-host~$0.059–0.52 | est.~100 | 1/7 benchmarks measured | Verified | ||||
| 78 | SpaceXAI (xAI) | 38.1±7.8 | $1.25 | 65 | 2/7 benchmarks measured | Verified | ||||
| 79 | OpenAI | 38.1±5.9 | $11.3est.~$13/task | 123 | 3/7 benchmarks measured | Verified | ||||
| 80 | MiMo-V2.5Open | Xiaomi MiMo | 37.3±4.3 | $0.18est.~$0.12/task | 36 | 4/7 benchmarks measured | Verified | |||
| 81 | MiniCPM5-1BOpen | OpenBMB (MiniCPM) | 37.1±10.0 | self-host~$0.021–0.18 | est.~130 | 1/7 benchmarks measured | Verified | |||
| 82 | Alibaba Qwen | 37.0±4.3 | $1.35est.~$1.5/task | 86 | 4/7 benchmarks measured | Verified | ||||
| 83 | NVIDIA | 36.9±8.3 | self-host~$0.10–0.92 | est.~170 | 2/7 benchmarks measured | Lab-reported | ||||
| 84 | Qwen3.5 2BOpen | Alibaba Qwen | 36.8±10.0 | self-host~$0.030–0.27 | est.~93 | 1/7 benchmarks measured | Verified | |||
| 85 | Alibaba Qwen | 36.7±4.3 | $1.10est.~$1.4/task | 129 | 4/7 benchmarks measured | Verified | ||||
| 86 | A.X-K2Open | SK Telecom | 36.2±10.0 | self-host~$0.25–2.21 | est.~83 | 1/7 benchmarks measured | Verified | |||
| 87 | Ring-2.6-1TOpen | inclusionAI (Ant Group) | 35.9±4.3 | $0.85est.~$1.1/task | 119 | 4/7 benchmarks measured | Verified | |||
| 88 | Muse GlimmerOpen | Meta | 35.8±4.7 | $0.58est.~$0.57/task | 134 | 4/7 benchmarks measured | Mixed | |||
| 89 | Qwen3.6 35B A3BOpen | Alibaba Qwen | 34.1±4.3 | $0.84est.~$0.95/task | 120 | 4/7 benchmarks measured | Verified | |||
| 90 | Mistral AI | 34.0±3.4 | $3.00est.~$3.2/task | 149 | 5/7 benchmarks measured | Mixed | ||||
| 91 | Qwen3.5 9BOpen | Alibaba Qwen | 33.3±5.9 | $0.19 | 96 | 3/7 benchmarks measured | Verified | |||
| 92 | Kwaipilot (Kuaishou) | 33.1±5.9 | $0.52 | est.~100 | 3/7 benchmarks measured | Verified | ||||
| 93 | Ling 3.0 TinyOpen | inclusionAI (Ant Group) | 32.3±10.1 | self-host~$0.029–0.24 | 18 | 1/7 benchmarks measured | Verified | |||
| 94 | NVIDIA | 32.2±7.8 | self-host~$0.044–0.37 | est.~200 | 2/7 benchmarks measured | Verified | ||||
| 95 | LG AI Research (EXAONE) | 31.8±10.0 | self-host~$0.29–2.58 | est.~81 | 1/7 benchmarks measured | Verified | ||||
| 96 | K2 Horizon 3.7BOpen | MBZUAI Institute of Foundation Models | 31.5±5.9 | self-host~$0.056–0.50 | est.~120 | 3/7 benchmarks measured | Verified | |||
| 97 | Alibaba Qwen | 31.0±7.8 | $0.06 | 22 | 2/7 benchmarks measured | Verified | ||||
| 98 | Nemotron 3 UltraOpen | NVIDIA | 30.2±3.4 | $1.07est.~$1.1/task | 155 | 5/7 benchmarks measured | Mixed | |||
| 99 | Qwen3.5 0.8BOpen | Alibaba Qwen | 29.7±10.0 | self-host~$0.018–0.15 | est.~100 | 1/7 benchmarks measured | Verified | |||
| 100 | Gemma 4 31BOpen | Google DeepMind | 29.6±4.3 | $0.22est.~$0.17/task | 35 | 4/7 benchmarks measured | Verified | |||
| 101 | Arcee AI | 29.4±4.3 | $0.39est.~$0.34/task | 337 | 4/7 benchmarks measured | Verified | ||||
| 103 | Sarvam 105BOpen | Sarvam AI | 28.8±10.0 | $0.07 | est.~95 | 1/7 benchmarks measured | Verified | |||
| 104 | gpt-oss-120bOpen | OpenAI | 27.8±4.3 | $0.24est.~$0.21/task | 245 | 4/7 benchmarks measured | Verified | |||
| 105 | Gemma 4 26B A4BOpen | Google DeepMind | 27.8±5.9 | $0.18est.~$0.17/task | 75 | 3/7 benchmarks measured | Verified | |||
| 106 | Command A+Open | Cohere | 27.8±4.3 | $0.60est.~$0.63/task | 152 | 4/7 benchmarks measured | Verified | |||
| 107 | NVIDIA | 27.7±4.3 | $0.45est.~$0.38/task | 164 | 4/7 benchmarks measured | Verified | ||||
| 108 | LongCat 2.0Open | Meituan LongCat | 27.3±5.9 | $1.30est.~$1.2/task | 65 | 3/7 benchmarks measured | Verified | |||
| 109 | MiniCPM5-2BOpen | OpenBMB (MiniCPM) | 27.0±5.9 | self-host~$0.035–0.31 | est.~110 | 3/7 benchmarks measured | Verified | |||
| 110 | Qwen3 Coder NextOpen | Alibaba Qwen | 26.6±4.3 | $0.68est.~$0.51/task | 94 | 4/7 benchmarks measured | Verified | |||
| 111 | Multiverse Computing | 26.6±5.9 | self-host~$0.066–0.59 | est.~100 | 3/7 benchmarks measured | Verified | ||||
| 112 | NVIDIA | 26.4±7.8 | $0.45 | 275 | 2/7 benchmarks measured | Verified | ||||
| 113 | Gemma 4 12BOpen | Google DeepMind | 24.3±10.0 | $0.15 | 118 | 1/7 benchmarks measured | Verified | |||
| 115 | Granite 4.2 30BOpen | IBM Granite | 23.5±5.9 | $0.28est.~$0.27/task | 77 | 3/7 benchmarks measured | Verified | |||
| 116 | gpt-oss-20bOpen | OpenAI | 23.5±4.3 | $0.11est.~$0.09/task | 240 | 4/7 benchmarks measured | Verified | |||
| 117 | Nanbeige4.1-3BOpen | Nanbeige | 23.3±10.0 | self-host~$0.047–0.42 | est.~110 | 1/7 benchmarks measured | Verified | |||
| 119 | INTELLECT-3Open | Prime Intellect | 22.8±10.0 | self-host~$0.12–0.97 | est.~94 | 1/7 benchmarks measured | Verified | |||
| 120 | Falcon-H1R-7BOpen | TII (Falcon) | 22.6±10.0 | self-host~$0.074–0.66 | est.~99 | 1/7 benchmarks measured | Verified | |||
| 124 | Sarvam 30BOpen | Sarvam AI | 21.4±10.0 | $0.05 | est.~110 | 1/7 benchmarks measured | Verified | |||
| 125 | Inception | 21.1±7.8 | $0.34est.~$0.32/task | 781 | 2/7 benchmarks measured | Verified | ||||
| 126 | NVIDIA | 20.6±5.9 | $0.10est.~$0.08/task | 267 | 3/7 benchmarks measured | Verified | ||||
| 127 | Nous Research | 20.5±10.0 | $1.50 | 42 | 1/7 benchmarks measured | Verified | ||||
| 129 | Granite 4.2 8BOpen | IBM Granite | 19.4±5.9 | $0.11est.~$0.10/task | 62 | 3/7 benchmarks measured | Verified | |||
| 130 | North Mini CodeOpen | Cohere | 18.6±4.3 | self-host~$0.044–0.37 | 111 | 4/7 benchmarks measured | Verified | |||
| 131 | NVIDIA | 18.4±5.9 | $0.09est.~$0.08/task | 245 | 3/7 benchmarks measured | Verified | ||||
| 132 | LFM2.5-2.6BOpen | Liquid AI | 18.3±10.0 | self-host~$0.037–0.33 | est.~110 | 1/7 benchmarks measured | Verified | |||
| 134 | Gemma 4 E4BOpen | Google DeepMind | 18.2±10.0 | $0.04 | 30 | 1/7 benchmarks measured | Verified | |||
| 135 | NVIDIA | 18.0±10.0 | self-host~$0.047–0.42 | est.~190 | 1/7 benchmarks measured | Verified | ||||
| 140 | IBM Granite | 16.7±5.9 | $0.05est.~$0.05/task | 220 | 3/7 benchmarks measured | Verified | ||||
| 143 | Gemma 4 E2BOpen | Google DeepMind | 16.0±10.0 | self-host~$0.035–0.32 | est.~79 | 1/7 benchmarks measured | Verified | |||
| 145 | Celeris | 15.8±5.9 | $0.33est.~$0.29/task | 1521 | 3/7 benchmarks measured | Verified | ||||
| 146 | Ai2 (Allen Institute) | 15.8±10.0 | self-host~$0.16–1.46 | est.~83 | 1/7 benchmarks measured | Verified | ||||
| 148 | LFM2.5-8B-A1BOpen | Liquid AI | 15.5±10.0 | self-host~$0.031–0.26 | est.~120 | 1/7 benchmarks measured | Verified | |||
| 150 | Nous Research | 15.2±10.0 | self-host~$0.35–3.12 | est.~67 | 1/7 benchmarks measured | Verified | ||||
| 151 | Baidu ERNIE | 15.0±10.0 | $0.49 | est.~79 | 1/7 benchmarks measured | Verified | ||||
| 154 | K2 Horizon 0.9BOpen | MBZUAI Institute of Foundation Models | 14.7±7.8 | self-host~$0.021–0.18 | est.~140 | 2/7 benchmarks measured | Verified | |||
| 156 | AI21 Labs | 14.4±10.0 | self-host~$0.041–0.37 | est.~110 | 1/7 benchmarks measured | Verified | ||||
| 164 | Jamba 1.7 LargeOpen | AI21 Labs | 13.3±10.0 | self-host~$0.55–4.92 | est.~72 | 1/7 benchmarks measured | Verified | |||
| 166 | Mistral Small 4Open | Mistral AI | 13.2±3.4 | $0.26est.~$0.25/task | 170 | 5/7 benchmarks measured | Mixed | |||
| 169 | Swiss AI Initiative (Apertus) | 13.0±10.0 | $1.34 | est.~75 | 1/7 benchmarks measured | Verified | ||||
| 171 | LFM2 24B A2BOpen | Liquid AI | 13.0±10.0 | self-host~$0.051–0.42 | est.~110 | 1/7 benchmarks measured | Verified | |||
| 175 | Swiss AI Initiative (Apertus) | 12.7±10.0 | $0.13 | est.~98 | 1/7 benchmarks measured | Verified | ||||
| 179 | Ai2 (Allen Institute) | 11.6±10.0 | self-host~$0.16–1.46 | est.~83 | 1/7 benchmarks measured | Verified | ||||
| 184 | Reka Flash 3Open | Reka AI | 10.3±10.0 | $0.35 | 94 | 1/7 benchmarks measured | Verified | |||
| 186 | Tiny Aya GlobalOpen | Cohere | 10.0±10.0 | self-host~$0.042–0.38 | est.~120 | 1/7 benchmarks measured | Verified |
About agents
Tool use, computer use, and web research. Quality is a weighted average of the benchmarks below, each rescaled so 100 = the best tracked model. Benchmarks without a published score are estimated from related ones (shown dashed). Dot fill shows the evidence: solid = strong, tinted = medium, empty ring = weak (few benchmarks measured, lab-reported only or provisional). Methodology
- τ²-bench (Telecom)(day 0)
- OSWorld-Verified(day 0)
- OSWorld 2.0(day 0)
- BrowseComp(day 0)
- GDPval-AA (Elo)(third-party)
- AutomationBench-AA(third-party)
- τ-Bench Banking (AA)(third-party)
Not comparable across labs (4)
Kept for reference, not counted in rankings: these use a lab-specific task set, answer key or scoring, so scores can't be compared fairly across labs. Only published scores are shown.
Day-0 (model cards) Third-party
- Fully verified
- 83%
- of 187 models