Skip to content
Model Pareto

Compare models

Side by side: quality per category, price, speed, and every benchmark cell with where it came from. Pick up to four.
GPT-5.6 TerraGrok 4.7MiniMax-M3
Focus

Coding: quality vs price

Compared models are ringed; the other 100 ranked here are greyed.

Lower price is better. Pareto frontier: Granite 4.2 3B, NVIDIA Nemotron 3 Nano 30B A3B, gpt-oss-20b, Ling-3.0-flash-VL, MiMo-V2.6-Flash, GLM-5.3 Flash, DeepSeek V4.1 Flash, MiMo-V2.6-Pro, Claude Sonnet 5.5, Claude Opus 5.5. 26 models are not plotted: Xing4.0-29B-A4B, Nex-N2.5-Pro, Atria Dawn Preview, Intern-S2-397B, Solar Open2 250B, Phi-4-reasoning-plus, Motif 3, Nex-N2-Pro, Nex-N2.5-Mini, A.X-K2, K2 Horizon 375B A23B, K-EXAONE 2.0 0803, K2 Horizon MoVA 36B A4B, Intern-S2-Preview (35B-A3B), Command A+, North Mini Code, G9v3-39A5B, Falcon-H1-34B-Instruct, Devstral 2, K2 Horizon 7B, Devstral Small 2, MiniCPM5-2B, Ling 3.0 Tiny, K2 Horizon 3.7B, K2 Horizon 0.9B, LFM2.5-2.6B.

26 models with no price data — shown in the strip at the left edge

Xing4.0-29B-A4B, Nex-N2.5-Pro, Atria Dawn Preview, Intern-S2-397B, Solar Open2 250B, Phi-4-reasoning-plus, Motif 3, Nex-N2-Pro, Nex-N2.5-Mini, A.X-K2, K2 Horizon 375B A23B, K-EXAONE 2.0 0803, K2 Horizon MoVA 36B A4B, Intern-S2-Preview (35B-A3B), Command A+, North Mini Code, G9v3-39A5B, Falcon-H1-34B-Instruct, Devstral 2, K2 Horizon 7B, Devstral Small 2, MiniCPM5-2B, Ling 3.0 Tiny, K2 Horizon 3.7B, K2 Horizon 0.9B, LFM2.5-2.6B

  • Best-value frontier (nothing is both cheaper and better)
  • Evidencestrong → weak
  • Estimated from other categories
  • GPT-5.6 Terra
    Quality
    69.8
    Rank
    #12/103
    Price
    $4.50/M tok
    Speed
    83tok/s
    In$2.00Out$12/M tok

    vs Grok 4.7: −2.9 quality · 1.5× price

  • Grok 4.7
    Quality
    72.7
    Rank
    #11/103
    Price
    $3.00/M tok
    Speed
    40tok/s
    In$2.00Out$6.00/M tok

    vs GPT-5.6 Terra: +2.9 quality · 0.67× price

  • MiniMax-M3
    Quality
    44.1
    Rank
    #37/103
    Price
    $0.52/M tok
    Speed
    118tok/s
    In$0.30▾Out$1.20▾/M tok

    vs Grok 4.7: −28.7 quality · 0.17× price

Overview

Metric
GPT-5.6 Terra
Grok 4.7
MiniMax-M3
Lab
OpenAI
SpaceXAI (xAI)
MiniMax
Released
Jul 9, 2026
Sep 21, 2026
Jun 1, 2026
Weights
Proprietary
Proprietary
Open
Input price
$/M tok
$2.00
$2.00
$0.30Best
Output price
$/M tok
$12
$6.00
$1.20Best
Blended price
$/M tok · 3:1 in:out
$4.50
$3.00
$0.525Best
Output speed
tok/s
83
40
118Best
⚡ SambaNova 246
Context
tokens
1MBest
500K
1MBest

Quality by category

0–100 within each category (100 = best tracked model). Rank is among all models ranked there. Click a row to focus it.

Metric
GPT-5.6 Terra
Grok 4.7
MiniMax-M3
Coding
69.8±5.2
#12/103Mixed
72.7±4.5Best
#11/103Verified
44.1±5.4
#37/103Mixed
Writing & chat
71.7±3.3Best
#23/146Verified
70.9±4.3
#25/146Verified
71.1±4.2
#24/146Verified
Vision
78.1±4.8Best
#8/82Verified
64.1±7.3
#23/82Verified
63.8±5.3
#24/82Mixed
Hard reasoning
80.1±3.7
#16/182Verified
81.8±5.1Best
#14/182Verified
70.7±3.7
#30/182Verified
Agents
72.3±3.2
#22/173Mixed
86.7±7.8Best
#5/173Verified
47.4±3.4
#38/173Mixed

Coding benchmarks

Rank among models with a published score, and the leaderboard around each model. ~ italic = no published score, estimated from related benchmarks.

Metric
GPT-5.6 Terra
Grok 4.7
MiniMax-M3
SWE-bench Verified
day 0
~#2/14~85.8%Estimated
  1. #1Claude Opus 596.0%
  2. ~#2GPT-5.6 TerraEstimated85.8%
  3. #2Claude Sonnet 585.2%
estimated from related benchmarks
~#2/14~85.7%Estimated
  1. #1Claude Opus 596.0%
  2. ~#2Grok 4.7Estimated85.7%
  3. #2Claude Sonnet 585.2%
estimated from related benchmarks
#4/1380.5%Lab-reported
  1. #1Claude Opus 596.0%
  2. #3Gemini 3.1 Pro80.6%
  3. #4MiniMax-M380.5%
  4. #5Hy378.0%
minimax.io · 2026-06-01
SWE-bench Pro (Public)
day 0
#7/1863.4%BestLab-reported
  1. #1Claude Opus 5.589.9%
  2. #6Hy4 preview65.7%
  3. #7GPT-5.6 Terra63.4%
  4. #8Claude Sonnet 563.2%
openai.com · 2026-07-09
~#6/19~68.1%Estimated
  1. #1Claude Opus 5.589.9%
  2. #5Intern-S2-397B68.5%
  3. ~#6Grok 4.7Estimated68.1%
  4. #6Hy4 preview65.7%
estimated from related benchmarks
#11/1859.0%Lab-reported
  1. #1Claude Opus 5.589.9%
  2. #10Atria Dawn Preview59.6%
  3. #11MiniMax-M359.0%
  4. #12GPT-5.558.6%
minimax.io · 2026-06-01
DeepSWE v1.1
day 0
#6/3069.6%Lab-reported
  1. #1DeepSeek V4.1 Flash74.2%
  2. #5Claude Sonnet 5.571.0%
  3. #6GPT-5.6 Terra69.6%
  4. #7GPT-6 Sol69.0%
openai.com · 2026-07-09
#2/3072.6%BestVerified
  1. #1DeepSeek V4.1 Flash74.2%
  2. #2Grok 4.772.6%
  3. #3MiMo-V2.6-Pro71.9%
artificialanalysis.ai · 2026-09-24
~#27/31~53.8%Estimated
  1. #1DeepSeek V4.1 Flash74.2%
  2. #26Nex-N2.5-Pro55.8%
  3. ~#27MiniMax-M3Estimated53.8%
  4. #27Qwen3.8 Max (0902)51.0%
estimated from related benchmarks
Terminal-Bench 4.0
day 0
#9/8335.4%BestVerified
  1. #1Claude Sonnet 5.563.6%
  2. #8Qwen3.8 Max (0902)38.9%
  3. #9GPT-5.6 Terra35.4%
  4. #10MiMo-V2.6-Pro34.8%
artificialanalysis.ai · 2026-09-24
#15/8325.8%Verified
  1. #1Claude Sonnet 5.563.6%
  2. #14DeepSeek V4.1 Flash26.8%
  3. #15Grok 4.725.8%
  4. #16Qwen3.8 Flash-Next25.3%
artificialanalysis.ai · 2026-09-24
#29/832.0%Verified
  1. #1Claude Sonnet 5.563.6%
  2. #29GPT-5.4 mini2.0%
  3. #29MiniMax-M32.0%
  4. #31K2 Horizon 375B A23B1.5%
artificialanalysis.ai · 2026-09-24
LiveCodeBench
third-party
~#2/20~92.1%Estimated
  1. #1Qwen3.8-Omni-Flash92.6%
  2. ~#2GPT-5.6 TerraEstimated92.1%
  3. #2Qwen3.8 Flash-Next91.9%
estimated from related benchmarks
~#4/20~89.5%Estimated
  1. #1Qwen3.8-Omni-Flash92.6%
  2. #3Qwen3.8 27B90.3%
  3. ~#4Grok 4.7Estimated89.5%
  4. #4Nemotron 3 Ultra89.0%
estimated from related benchmarks
~#6/20~80.6%Estimated
  1. #1Qwen3.8-Omni-Flash92.6%
  2. #5gpt-oss-120b87.8%
  3. ~#6MiniMax-M3Estimated80.6%
  4. #6Gemma 4 31B80.0%
estimated from related benchmarks
SciCode
third-party
#16/9555.0%Verified
  1. #1Claude Opus 5.566.9%
  2. #15GPT-5.555.8%
  3. #16GPT-5.6 Terra55.0%
  4. #17GPT-6 Luna54.6%
artificialanalysis.ai · 2026-09-24
#11/9557.4%BestVerified
  1. #1Claude Opus 5.566.9%
  2. #10GPT-6 Sol57.6%
  3. #11Grok 4.757.4%
  4. #12Gemini 3.8 Flash56.6%
artificialanalysis.ai · 2026-09-24
#36/9547.1%Verified
  1. #1Claude Opus 5.566.9%
  2. #35GPT-5.4 nano47.2%
  3. #36MiniMax-M347.1%
  4. #37Inkling47.0%
artificialanalysis.ai · 2026-09-24
AA Coding Agent Index
third-party
~#10/15~51.2Estimated
  1. #1Claude Opus 5.566.0
  2. #9Kimi K351.9
  3. ~#10GPT-5.6 TerraEstimated51.2
  4. #10Grok 4.647.0
estimated from related benchmarks
#6/1456.3Verified
  1. #1Claude Opus 5.566.0
  2. #5GPT-6 Sol56.7
  3. #6Grok 4.756.3
  4. #7Muse Spark 1.354.3
artificialanalysis.ai · 2026-09-24
~#15/15~41.0Estimated
  1. #1Claude Opus 5.566.0
  2. #14GPT-6 Luna41.1
  3. ~#15MiniMax-M3Estimated41.0
estimated from related benchmarks
Benchmarks in other categories (4)

Writing & chat benchmarks

Rank among models with a published score, and the leaderboard around each model. ~ italic = no published score, estimated from related benchmarks.

Metric
GPT-5.6 Terra
Grok 4.7
MiniMax-M3
IFBench
day 0
#25/12571.2%Verified
  1. #1MiniMax-M382.9%
  2. #24o371.4%
  3. #25GPT-5.6 Terra71.2%
  4. #26NVIDIA Nemotron 3 Nano 30B A3B71.1%
artificialanalysis.ai · 2026-09-24
~#21/126~73.8%Estimated
  1. #1MiniMax-M382.9%
  2. #20Command A+73.9%
  3. ~#21Grok 4.7Estimated73.8%
  4. #21GPT-5.4 mini73.3%
estimated from related benchmarks
#1/12582.9%BestVerified
  1. #1MiniMax-M382.9%
  2. #2Qwen3.8 2.4T A95B82.8%
artificialanalysis.ai · 2026-09-24
MMMLU
day 0
~#2/5~90.4%Estimated
  1. #1Gemini 3.1 Pro92.6%
  2. ~#2GPT-5.6 TerraEstimated90.4%
  3. #2Gemma 4 31B88.4%
estimated from related benchmarks
~#2/5~89.2%Estimated
  1. #1Gemini 3.1 Pro92.6%
  2. ~#2Grok 4.7Estimated89.2%
  3. #2Gemma 4 31B88.4%
estimated from related benchmarks
~#2/5~89.1%Estimated
  1. #1Gemini 3.1 Pro92.6%
  2. ~#2MiniMax-M3Estimated89.1%
  3. #2Gemma 4 31B88.4%
estimated from related benchmarks
LMArena Text, Non-English (Elo)
third-party
#15/531456BestVerified
  1. #1Claude Opus 5.51501
  2. #14GPT-6 AstraFew votes1460
  3. #15GPT-5.6 Terra1456
  4. #16DeepSeek V4 Pro (0813)1448
lmarena.ai · 2026-09-24
#26/531435Verified
  1. #1Claude Opus 5.51501
  2. #25GPT-6 Luna1436
  3. #26Grok 4.71435
  4. #27Qwen3.5 397B A17B1434
lmarena.ai · 2026-09-25
#30/531427Verified
  1. #1Claude Opus 5.51501
  2. #29Qwen3.8 27B1429
  3. #30MiniMax-M31427
  4. #31Gemma 4 26B A4BFew votes1423
lmarena.ai · 2026-09-24
LMArena Text (Elo)
third-party
#15/531466BestVerified
  1. #1Claude Opus 5.51509
  2. #14GLM-5.3 Flash1475
  3. #15GPT-5.6 Terra1466
  4. #16DeepSeek V4 Pro (0813)1463
lmarena.ai · 2026-09-24
#29/531439Verified
  1. #1Claude Opus 5.51509
  2. #28Inkling1440
  3. #29Grok 4.71439
  4. #30Gemma 4 26B A4B1438
lmarena.ai · 2026-09-25
#27/531441Verified
  1. #1Claude Opus 5.51509
  2. #25Qwen3.5 397B A17B1442
  3. #27MiniMax-M31441
  4. #28Inkling1440
lmarena.ai · 2026-09-24
EQ-Bench Creative Writing v3 (Elo)
third-party
#10/251855Verified
  1. #1GPT-6 Astra2173
  2. #9Muse Spark 1.31906
  3. #10GPT-5.6 Terra1855
  4. #11GPT-5.51844
eqbench.com · 2026-09-24
#8/252007BestVerified
  1. #1GPT-6 Astra2173
  2. #7Claude Opus 5.52050
  3. #8Grok 4.72007
  4. #9Muse Spark 1.31906
eqbench.com · 2026-09-24
~#10/26~1863Estimated
  1. #1GPT-6 Astra2173
  2. #9Muse Spark 1.31906
  3. ~#10MiniMax-M3Estimated1863
  4. #10GPT-5.6 Terra1855
estimated from related benchmarks

Vision benchmarks

Rank among models with a published score, and the leaderboard around each model. ~ italic = no published score, estimated from related benchmarks.

Metric
GPT-5.6 Terra
Grok 4.7
MiniMax-M3
MMMU
day 0
~#2/3~71.3%Estimated
  1. #1Claude Haiku 4.573.2%
  2. ~#2GPT-5.6 TerraEstimated71.3%
  3. #2Llama 4 Maverick69.4%
estimated from related benchmarks
~#2/3~71.3%Estimated
  1. #1Claude Haiku 4.573.2%
  2. ~#2Grok 4.7Estimated71.3%
  3. #2Llama 4 Maverick69.4%
estimated from related benchmarks
~#2/3~71.3%Estimated
  1. #1Claude Haiku 4.573.2%
  2. ~#2MiniMax-M3Estimated71.3%
  3. #2Llama 4 Maverick69.4%
estimated from related benchmarks
MMMU-Pro
day 0
#10/7680.7%BestVerified
  1. #1Claude Opus 5.587.7%
  2. #9Intern-S2-397B81.7%
  3. #10GPT-5.6 Terra80.7%
  4. #11Kimi K380.5%
artificialanalysis.ai · 2026-09-24
~#11/77~80.5%Estimated
  1. #1Claude Opus 5.587.7%
  2. #10GPT-5.6 Terra80.7%
  3. ~#11Grok 4.7Estimated80.5%
  4. #11Kimi K380.5%
estimated from related benchmarks
#18/7678.6%Verified
  1. #1Claude Opus 5.587.7%
  2. #16Ling-3.0-flash-VL79.0%
  3. #18MiniMax-M378.6%
  4. #19GPT-5.3 Codex78.5%
artificialanalysis.ai · 2026-09-24
CharXiv Reasoning
day 0
~#4/9~83.8%Estimated
  1. #1Gemini 3.8 Flash86.2%
  2. #3Qwen3.8 Flash-Next84.6%
  3. ~#4GPT-5.6 TerraEstimated83.8%
  4. #4Qwen3.8-Omni-Flash83.5%
estimated from related benchmarks
~#5/9~81.4%Estimated
  1. #1Gemini 3.8 Flash86.2%
  2. #4Qwen3.8-Omni-Flash83.5%
  3. ~#5Grok 4.7Estimated81.4%
  4. #5Muse Glimmer78.8%
estimated from related benchmarks
~#5/9~79.3%Estimated
  1. #1Gemini 3.8 Flash86.2%
  2. #4Qwen3.8-Omni-Flash83.5%
  3. ~#5MiniMax-M3Estimated79.3%
  4. #5Muse Glimmer78.8%
estimated from related benchmarks
OmniDocBench v1.5
third-party
~#4/8~90.1%Estimated
  1. #1MiniMax-M391.6%
  2. #2Qwen3.8 27B91.1%
  3. ~#4GPT-5.6 TerraEstimated90.1%
  4. #4Gemini 3.1 Pro85.3%
estimated from related benchmarks
~#4/8~87.1%Estimated
  1. #1MiniMax-M391.6%
  2. #2Qwen3.8 27B91.1%
  3. ~#4Grok 4.7Estimated87.1%
  4. #4Gemini 3.1 Pro85.3%
estimated from related benchmarks
#1/791.6%Lab-reported
  1. #1MiniMax-M391.6%
  2. #2Kimi K391.1%
minimax.io · 2026-06-01
GDP.pdf (AA)
third-party
#6/4224.0%BestVerified
  1. #1GPT-6 Astra31.0%
  2. #5GPT-6 Sol24.8%
  3. #6GPT-5.6 Terra24.0%
  4. #7Qwen3.8 Max (0902)22.8%
artificialanalysis.ai · 2026-09-24
#13/4220.0%Verified
  1. #1GPT-6 Astra31.0%
  2. #12GPT-6 Luna20.4%
  3. #13Grok 4.720.0%
  4. #14MiMo-V2.6-Pro19.2%
artificialanalysis.ai · 2026-09-24
#29/429.8%Verified
  1. #1GPT-6 Astra31.0%
  2. #28Muse Glimmer10.0%
  3. #29MiniMax-M39.8%
  4. #30Ling-3.0-flash-VL8.4%
artificialanalysis.ai · 2026-09-24
Chartography
third-party
#6/2234.0%BestVerified
  1. #1GPT-6 Astra71.0%
  2. #5Gemini 3.8 Flash40.9%
  3. #6GPT-5.6 Terra34.0%
  4. #7GPT-5.531.0%
surgehq.ai · 2026-09-24
#18/2214.7%Verified
  1. #1GPT-6 Astra71.0%
  2. #17GLM-5.3 Flash16.3%
  3. #18Grok 4.714.7%
  4. #19DeepSeek V4.1 Flash11.6%
surgehq.ai · 2026-09-24
~#15/23~19.7%Estimated
  1. #1GPT-6 Astra71.0%
  2. #14Grok 4.620.5%
  3. ~#15MiniMax-M3Estimated19.7%
  4. #15Muse Glimmer17.2%
estimated from related benchmarks

Hard reasoning benchmarks

Rank among models with a published score, and the leaderboard around each model. ~ italic = no published score, estimated from related benchmarks.

Metric
GPT-5.6 Terra
Grok 4.7
MiniMax-M3
GPQA Diamond
day 0
#15/17292.5%Verified
  1. #1GPT-6 Astra96.1%
  2. #13Qwen3.8 Max (0902)92.8%
  3. #15GPT-5.6 Terra92.5%
  4. #16Hy4 preview92.3%
artificialanalysis.ai · 2026-09-24
~#16/173~92.3%Estimated
  1. #1GPT-6 Astra96.1%
  2. #15GPT-5.6 Terra92.5%
  3. ~#16Grok 4.7Estimated92.3%
  4. #16Hy4 preview92.3%
estimated from related benchmarks
#12/17292.9%BestVerified
  1. #1GPT-6 Astra96.1%
  2. #11Claude Opus 593.2%
  3. #12MiniMax-M392.9%
  4. #13DeepSeek V4 Pro (0813)92.8%
artificialanalysis.ai · 2026-09-24
Humanity's Last Exam
day 0
#18/17842.9%Verified
  1. #1Claude Opus 5.561.4%
  2. #16Qwen3.8 Max (0902)43.1%
  3. #18GPT-5.6 Terra42.9%
  4. #19GPT-5.3 Codex42.5%
artificialanalysis.ai · 2026-09-24
#16/17843.1%BestVerified
  1. #1Claude Opus 5.561.4%
  2. #15Hy4 preview43.4%
  3. #16Grok 4.743.1%
  4. #16Qwen3.8 Max (0902)43.1%
artificialanalysis.ai · 2026-09-24
#26/17839.0%Verified
  1. #1Claude Opus 5.561.4%
  2. #25DeepSeek V4.1 Flash39.2%
  3. #26MiniMax-M339.0%
  4. #27GPT-6 Luna38.5%
artificialanalysis.ai · 2026-09-24
AIME (latest)
day 0
~#2/25~96.8%Estimated
  1. #1Inkling97.1%
  2. ~#2GPT-5.6 TerraEstimated96.8%
  3. #2Muse Glimmer94.7%
estimated from related benchmarks
~#2/25~96.5%Estimated
  1. #1Inkling97.1%
  2. ~#2Grok 4.7Estimated96.5%
  3. #2Muse Glimmer94.7%
estimated from related benchmarks
~#2/25~95.8%Estimated
  1. #1Inkling97.1%
  2. ~#2MiniMax-M3Estimated95.8%
  3. #2Muse Glimmer94.7%
estimated from related benchmarks
AA Intelligence Index
third-party
#15/7442.1Verified
  1. #1Claude Opus 5.557.6
  2. #14Kimi K343.6
  3. #15GPT-5.6 Terra42.1
  4. #16GLM-5.3 Flash41.8
artificialanalysis.ai · 2026-09-24
#8/7446.4BestVerified
  1. #1Claude Opus 5.557.6
  2. #7GPT-6 Sol47.5
  3. #8Grok 4.746.4
  4. #9MiMo-V2.6-Pro46.3
artificialanalysis.ai · 2026-09-24
#28/7429.2Verified
  1. #1Claude Opus 5.557.6
  2. #27Gemini 3.1 Pro29.7
  3. #28MiniMax-M329.2
  4. #29Quasar 438B26.7
artificialanalysis.ai · 2026-09-24

Agents benchmarks

Rank among models with a published score, and the leaderboard around each model. ~ italic = no published score, estimated from related benchmarks.

Metric
GPT-5.6 Terra
Grok 4.7
MiniMax-M3
τ²-bench (Telecom)
day 0
#22/11586.3%Verified
  1. #1Step 3.7 Flash98.5%
  2. #21Qwen3.5 9B86.8%
  3. #22GPT-5.6 Terra86.3%
  4. #23GPT-5.3 Codex86.0%
artificialanalysis.ai · 2026-09-24
~#2/116~96.4%Estimated
  1. #1Step 3.7 Flash98.5%
  2. ~#2Grok 4.7Estimated96.4%
  3. #2Gemini 3.1 Pro95.6%
estimated from related benchmarks
#16/11588.9%BestVerified
  1. #1Step 3.7 Flash98.5%
  2. #15KAT Coder Pro V289.5%
  3. #16MiniMax-M388.9%
  4. #17Qwen3.5 Omni Plus88.3%
artificialanalysis.ai · 2026-09-24
OSWorld-Verified
day 0
~#6/12~81.2%Estimated
  1. #1Kimi K384.8%
  2. #5Claude Sonnet 581.2%
  3. ~#6GPT-5.6 TerraEstimated81.2%
  4. #6MiMo-V2.6-Flash80.8%
estimated from related benchmarks
~#3/12~82.3%Estimated
  1. #1Kimi K384.8%
  2. #2Qwen3.8 27B84.3%
  3. ~#3Grok 4.7Estimated82.3%
  4. #3Nex-N2.5-Pro82.2%
estimated from related benchmarks
~#10/12~70.6%Estimated
  1. #1Kimi K384.8%
  2. #9Nex-N2.5-Mini71.2%
  3. ~#10MiniMax-M3Estimated70.6%
  4. #10Muse Glimmer65.9%
estimated from related benchmarks
OSWorld 2.0
day 0
#3/450.2%Lab-reported
  1. #1GLM-5.3 Flash59.1%
  2. #2Kimi K358.3%
  3. #3GPT-5.6 Terra50.2%
  4. #4GPT-5.547.5%
openai.com · 2026-07-09
~#3/5~58.3%Estimated
  1. #1GLM-5.3 Flash59.1%
  2. #2Kimi K358.3%
  3. ~#3Grok 4.7Estimated58.3%
  4. #3GPT-5.6 Terra50.2%
estimated from related benchmarks
~last/5below measured range (<47.5%)Estimated
  1. #1GLM-5.3 Flash59.1%
  2. #4GPT-5.547.5%
  3. ~#5MiniMax-M3Estimated<47.5%
estimated from related benchmarks
BrowseComp
day 0
#7/1787.5%BestLab-reported
  1. #1Atria Dawn Preview92.5%
  2. #6Step 5 Preview88.7%
  3. #7GPT-5.6 Terra87.5%
  4. #8Gemini 3.1 Pro85.9%
openai.com · 2026-07-09
~#7/18~88.6%Estimated
  1. #1Atria Dawn Preview92.5%
  2. #6Step 5 Preview88.7%
  3. ~#7Grok 4.7Estimated88.6%
  4. #7GPT-5.6 Terra87.5%
estimated from related benchmarks
#12/1783.5%Lab-reported
  1. #1Atria Dawn Preview92.5%
  2. #11Hy384.2%
  3. #12MiniMax-M383.5%
  4. #13Nex-N2.5-Mini83.4%
minimax.io · 2026-06-01
GDPval-AA (Elo)
third-party
#20/861432Verified
  1. #1Claude Opus 5.51846
  2. #19DeepSeek V4 Pro (0813)1441
  3. #20GPT-5.6 Terra1432
  4. #21Gemini 3.8 Flash1412
artificialanalysis.ai · 2026-09-24
#4/861695BestVerified
  1. #1Claude Opus 5.51846
  2. #3Claude Opus 51708
  3. #4Grok 4.71695
  4. #5Muse Spark 1.31674
artificialanalysis.ai · 2026-09-24
#26/861230Verified
  1. #1Claude Opus 5.51846
  2. #25GPT-5.51336
  3. #26MiniMax-M31230
  4. #27Apodex 1.11189
artificialanalysis.ai · 2026-09-24
AutomationBench-AA
third-party
#10/7959.6%Verified
  1. #1Claude Opus 5.569.5%
  2. #9Gemini 3.8 Flash59.9%
  3. #10GPT-5.6 Terra59.6%
  4. #11Claude Fable 5.159.4%
artificialanalysis.ai · 2026-09-24
#5/7965.6%BestVerified
  1. #1Claude Opus 5.569.5%
  2. #4Grok 4.667.0%
  3. #5Grok 4.765.6%
  4. #6GLM-5.362.2%
artificialanalysis.ai · 2026-09-24
#34/7921.3%Verified
  1. #1Claude Opus 5.569.5%
  2. #33Quasar 438B23.9%
  3. #34MiniMax-M321.3%
  4. #35K2 Horizon 7B20.9%
artificialanalysis.ai · 2026-09-24
τ-Bench Banking (AA)
third-party
#14/8840.2%BestVerified
  1. #1Muse Spark 1.350.5%
  2. #13GPT-6 Astra41.4%
  3. #14GPT-5.6 Terra40.2%
  4. #15DeepSeek V4 Pro (0813)39.6%
artificialanalysis.ai · 2026-09-24
~#11/89~43.4%Estimated
  1. #1Muse Spark 1.350.5%
  2. #10Gemini 3.8 Flash44.9%
  3. ~#11Grok 4.7Estimated43.4%
  4. #11Grok 4.643.3%
estimated from related benchmarks
#45/8815.3%Verified
  1. #1Muse Spark 1.350.5%
  2. #44A.X-K216.1%
  3. #45MiniMax-M315.3%
  4. #45Qwen3.5 122B A10B15.3%
artificialanalysis.ai · 2026-09-24
Not comparable across labs (1)
OSWorld-Verified (task subset)
day 0
—
—
#1/170.1%Lab-reported
minimax.io · 2026-06-01