Skip to content
Model Pareto

Compare models

Side by side: quality per category, price, speed, and every benchmark cell with where it came from. Pick up to four.
Gemini 3.8 FlashGrok 4.6Step 5 Preview
Focus

Coding: quality vs price

Compared models are ringed; the other 100 ranked here are greyed.

Lower price is better. Pareto frontier: Granite 4.2 3B, NVIDIA Nemotron 3 Nano 30B A3B, gpt-oss-20b, Ling-3.0-flash-VL, MiMo-V2.6-Flash, GLM-5.3 Flash, DeepSeek V4.1 Flash, MiMo-V2.6-Pro, Claude Sonnet 5.5, Claude Opus 5.5. 26 models are not plotted: Xing4.0-29B-A4B, Nex-N2.5-Pro, Atria Dawn Preview, Intern-S2-397B, Solar Open2 250B, Phi-4-reasoning-plus, Motif 3, Nex-N2-Pro, Nex-N2.5-Mini, A.X-K2, K2 Horizon 375B A23B, K-EXAONE 2.0 0803, K2 Horizon MoVA 36B A4B, Intern-S2-Preview (35B-A3B), Command A+, North Mini Code, G9v3-39A5B, Falcon-H1-34B-Instruct, Devstral 2, K2 Horizon 7B, Devstral Small 2, MiniCPM5-2B, Ling 3.0 Tiny, K2 Horizon 3.7B, K2 Horizon 0.9B, LFM2.5-2.6B.

26 models with no price data — shown in the strip at the left edge

Xing4.0-29B-A4B, Nex-N2.5-Pro, Atria Dawn Preview, Intern-S2-397B, Solar Open2 250B, Phi-4-reasoning-plus, Motif 3, Nex-N2-Pro, Nex-N2.5-Mini, A.X-K2, K2 Horizon 375B A23B, K-EXAONE 2.0 0803, K2 Horizon MoVA 36B A4B, Intern-S2-Preview (35B-A3B), Command A+, North Mini Code, G9v3-39A5B, Falcon-H1-34B-Instruct, Devstral 2, K2 Horizon 7B, Devstral Small 2, MiniCPM5-2B, Ling 3.0 Tiny, K2 Horizon 3.7B, K2 Horizon 0.9B, LFM2.5-2.6B

  • Best-value frontier (nothing is both cheaper and better)
  • Evidencestrong → weak
  • Estimated from other categories
  • Gemini 3.8 Flash
    Quality
    58.3
    Rank
    #26/103
    Price
    $1.50/M tok
    Speed
    291tok/s
    In$0.75▾Out$3.75/M tok

    vs Step 5 Preview: −15.4 quality · 1.1× price

  • Grok 4.6
    Quality
    59.0
    Rank
    #25/103
    Price
    $3.00/M tok
    Speed
    60tok/s
    In$2.00Out$6.00/M tok

    vs Step 5 Preview: −14.7 quality · 2.1× price

  • Step 5 Preview
    Quality
    73.7
    Rank
    #10/103
    Price
    $1.43/M tok
    Speed
    85tok/s
    In$1.00Out$2.70▾/M tok

    vs Grok 4.6: +14.7 quality · 0.48× price

Overview

Metric
Gemini 3.8 Flash
Grok 4.6
Step 5 Preview
Lab
Google DeepMind
SpaceXAI (xAI)
StepFun
Released
Sep 2, 2026
Aug 12, 2026
Sep 20, 2026
Weights
Proprietary
Proprietary
Proprietary
Input price
$/M tok
$0.75Best
$2.00
$1.00
Output price
$/M tok
$3.75
$6.00
$2.70Best
Blended price
$/M tok · 3:1 in:out
$1.50
$3.00
$1.425Best
Output speed
tok/s
291Best
60
85
Context
tokens
1MBest
500K
1MBest

Quality by category

0–100 within each category (100 = best tracked model). Rank is among all models ranked there. Click a row to focus it.

Metric
Gemini 3.8 Flash
Grok 4.6
Step 5 Preview
Coding
58.3±4.5
#26/103Verified
59.0±4.5
#25/103Verified
73.7±6.4Best
#10/103Mixed
Writing & chat
77.8±4.7
#15/146Verified
72.0±6.0
#22/146Verified
82.6±12.7Best
#8/146Estimated from other categoriesbest value
Vision
82.6±4.2Best
#5/82Mixedbest value
65.2±7.3
#21/82Verified
66.1±6.3
#20/82Verified
Hard reasoning
82.9±3.7
#11/182Verified
82.2±3.7
#12/182Verified
83.2±4.0Best
#10/182Mixed
Agents
76.1±5.8
#16/173Verified
84.1±5.8Best
#10/173Verified
75.4±6.3
#18/173Mixed

Coding benchmarks

Rank among models with a published score, and the leaderboard around each model. ~ italic = no published score, estimated from related benchmarks.

Metric
Gemini 3.8 Flash
Grok 4.6
Step 5 Preview
SWE-bench Verified
day 0
~#3/14~84.8%Estimated
  1. #1Claude Opus 596.0%
  2. #2Claude Sonnet 585.2%
  3. ~#3Gemini 3.8 FlashEstimated84.8%
  4. #3Gemini 3.1 Pro80.6%
estimated from related benchmarks
~#3/14~82.8%Estimated
  1. #1Claude Opus 596.0%
  2. #2Claude Sonnet 585.2%
  3. ~#3Grok 4.6Estimated82.8%
  4. #3Gemini 3.1 Pro80.6%
estimated from related benchmarks
~#2/14~88.2%Estimated
  1. #1Claude Opus 596.0%
  2. ~#2Step 5 PreviewEstimated88.2%
  3. #2Claude Sonnet 585.2%
estimated from related benchmarks
SWE-bench Pro (Public)
day 0
~#7/19~65.6%Estimated
  1. #1Claude Opus 5.589.9%
  2. #6Hy4 preview65.7%
  3. ~#7Gemini 3.8 FlashEstimated65.6%
  4. #7GPT-5.6 Terra63.4%
estimated from related benchmarks
~#7/19~64.1%Estimated
  1. #1Claude Opus 5.589.9%
  2. #6Hy4 preview65.7%
  3. ~#7Grok 4.6Estimated64.1%
  4. #7GPT-5.6 Terra63.4%
estimated from related benchmarks
~#5/19~70.2%Estimated
  1. #1Claude Opus 5.589.9%
  2. #4Claude Opus 579.2%
  3. ~#5Step 5 PreviewEstimated70.2%
  4. #5Intern-S2-397B68.5%
estimated from related benchmarks
DeepSWE v1.1
day 0
#14/3065.8%Verified
  1. #1DeepSeek V4.1 Flash74.2%
  2. #13GPT-5.567.0%
  3. #14Gemini 3.8 Flash65.8%
  4. #15Grok 4.664.9%
artificialanalysis.ai · 2026-09-24
#15/3064.9%Verified
  1. #1DeepSeek V4.1 Flash74.2%
  2. #14Gemini 3.8 Flash65.8%
  3. #15Grok 4.664.9%
  4. #16Claude Fable 5.164.3%
artificialanalysis.ai · 2026-09-24
#11/3067.7%BestLab-reported
  1. #1DeepSeek V4.1 Flash74.2%
  2. #10MiMo-V2.6-Flash67.9%
  3. #11Step 5 Preview67.7%
  4. #12GPT-6 Astra67.6%
stepfun.com · 2026-09-20
Terminal-Bench 4.0
day 0
#18/8319.7%Verified
  1. #1Claude Sonnet 5.563.6%
  2. #17MiMo-V2.6-Flash22.7%
  3. #18Gemini 3.8 Flash19.7%
  4. #19Grok 4.617.2%
artificialanalysis.ai · 2026-09-24
#19/8317.2%Verified
  1. #1Claude Sonnet 5.563.6%
  2. #18Gemini 3.8 Flash19.7%
  3. #19Grok 4.617.2%
  4. #20GPT-5.514.6%
artificialanalysis.ai · 2026-09-24
#11/8333.3%BestVerified
  1. #1Claude Sonnet 5.563.6%
  2. #11Muse Spark 1.333.3%
  3. #11Step 5 Preview33.3%
  4. #13GLM-5.3 Flash32.8%
artificialanalysis.ai · 2026-09-24
LiveCodeBench
third-party
~#3/20~91.7%Estimated
  1. #1Qwen3.8-Omni-Flash92.6%
  2. #2Qwen3.8 Flash-Next91.9%
  3. ~#3Gemini 3.8 FlashEstimated91.7%
  4. #3Qwen3.8 27B90.3%
estimated from related benchmarks
~#3/20~90.8%Estimated
  1. #1Qwen3.8-Omni-Flash92.6%
  2. #2Qwen3.8 Flash-Next91.9%
  3. ~#3Grok 4.6Estimated90.8%
  4. #3Qwen3.8 27B90.3%
estimated from related benchmarks
~#2/20~92.1%Estimated
  1. #1Qwen3.8-Omni-Flash92.6%
  2. ~#2Step 5 PreviewEstimated92.1%
  3. #2Qwen3.8 Flash-Next91.9%
estimated from related benchmarks
SciCode
third-party
#12/9556.6%Verified
  1. #1Claude Opus 5.566.9%
  2. #11Grok 4.757.4%
  3. #12Gemini 3.8 Flash56.6%
  4. #13GPT-6 Astra56.5%
artificialanalysis.ai · 2026-09-24
#20/9553.0%Verified
  1. #1Claude Opus 5.566.9%
  2. #19Qwen3.8 2.4T A95B54.1%
  3. #20Grok 4.653.0%
  4. #21GPT-5.5 Instant (June 2026)52.5%
artificialanalysis.ai · 2026-09-24
#7/9558.9%BestVerified
  1. #1Claude Opus 5.566.9%
  2. #6GLM-5.359.0%
  3. #7Step 5 Preview58.9%
  4. #8Muse Spark 1.358.8%
artificialanalysis.ai · 2026-09-24
AA Coding Agent Index
third-party
#13/1441.9Verified
  1. #1Claude Opus 5.566.0
  2. #12DeepSeek V4 Pro (0813)43.1
  3. #13Gemini 3.8 Flash41.9
  4. #14GPT-6 Luna41.1
artificialanalysis.ai · 2026-09-24
#10/1447.0BestVerified
  1. #1Claude Opus 5.566.0
  2. #9Kimi K351.9
  3. #10Grok 4.647.0
  4. #11Qwen3.8 Max (0902)43.3
artificialanalysis.ai · 2026-09-24
~#9/15~53.2Estimated
  1. #1Claude Opus 5.566.0
  2. #8GLM-5.353.6
  3. ~#9Step 5 PreviewEstimated53.2
  4. #9Kimi K351.9
estimated from related benchmarks
Benchmarks in other categories (4)

Writing & chat benchmarks

Rank among models with a published score, and the leaderboard around each model. ~ italic = no published score, estimated from related benchmarks.

Metric
Gemini 3.8 Flash
Grok 4.6
Step 5 Preview
IFBench
day 0
~#3/126~82.6%Estimated
  1. #1MiniMax-M382.9%
  2. #2Qwen3.8 2.4T A95B82.8%
  3. ~#3Gemini 3.8 FlashEstimated82.6%
  4. #3Qwen3.8-Omni-Flash81.5%
estimated from related benchmarks
~#20/126~74.7%Estimated
  1. #1MiniMax-M382.9%
  2. #19GPT-5.3 Codex75.4%
  3. ~#20Grok 4.6Estimated74.7%
  4. #20Command A+73.9%
estimated from related benchmarks
~#3/126~82.7%Estimated
  1. #1MiniMax-M382.9%
  2. #2Qwen3.8 2.4T A95B82.8%
  3. ~#3Step 5 PreviewEstimated82.7%
  4. #3Qwen3.8-Omni-Flash81.5%
estimated from related benchmarks
MMMLU
day 0
~#2/5~92.0%Estimated
  1. #1Gemini 3.1 Pro92.6%
  2. ~#2Gemini 3.8 FlashEstimated92.0%
  3. #2Gemma 4 31B88.4%
estimated from related benchmarks
~#2/5~89.6%Estimated
  1. #1Gemini 3.1 Pro92.6%
  2. ~#2Grok 4.6Estimated89.6%
  3. #2Gemma 4 31B88.4%
estimated from related benchmarks
~#2/5~91.2%Estimated
  1. #1Gemini 3.1 Pro92.6%
  2. ~#2Step 5 PreviewEstimated91.2%
  3. #2Gemma 4 31B88.4%
estimated from related benchmarks
LMArena Text, Non-English (Elo)
third-party
#4/531483BestVerifiedFew votes
  1. #1Claude Opus 5.51501
  2. #4Claude Opus 51483
  3. #4Gemini 3.8 FlashFew votes1483
  4. #6Gemini 3.1 Pro1480
lmarena.ai · 2026-09-25
#18/531447Verified
  1. #1Claude Opus 5.51501
  2. #18Claude Sonnet 51447
  3. #18Grok 4.61447
  4. #20Gemini 3.5 Flash-Lite1445
lmarena.ai · 2026-09-24
~#9/54~1469Estimated
  1. #1Claude Opus 5.51501
  2. #8GPT-5.51474
  3. ~#9Step 5 PreviewEstimated1469
  4. #9Qwen3.8 Max (0902)1467
estimated from related benchmarks
LMArena Text (Elo)
third-party
#3/531493BestVerified
  1. #1Claude Opus 5.51509
  2. #3Claude Opus 51493
  3. #3Gemini 3.8 Flash1493
  4. #3Muse Spark 1.31493
lmarena.ai · 2026-09-24
#22/531453Verified
  1. #1Claude Opus 5.51509
  2. #19Qwen3.7 Plus1456
  3. #22Grok 4.61453
  4. #23Gemma 4 31B1451
lmarena.ai · 2026-09-25
~#13/54~1479Estimated
  1. #1Claude Opus 5.51509
  2. #10MiMo-V2.6-Pro1480
  3. ~#13Step 5 PreviewEstimated1479
  4. #13DeepSeek V4.1 Flash1477
estimated from related benchmarks
EQ-Bench Creative Writing v3 (Elo)
third-party
#15/251748Verified
  1. #1GPT-6 Astra2173
  2. #14Claude Sonnet 51794
  3. #15Gemini 3.8 Flash1748
  4. #16Nemotron 3 Ultra1692
eqbench.com · 2026-09-24
~#10/26~1897Estimated
  1. #1GPT-6 Astra2173
  2. #9Muse Spark 1.31906
  3. ~#10Grok 4.6Estimated1897
  4. #10GPT-5.6 Terra1855
estimated from related benchmarks
~#9/26~1972Estimated
  1. #1GPT-6 Astra2173
  2. #8Grok 4.72007
  3. ~#9Step 5 PreviewEstimated1972
  4. #9Muse Spark 1.31906
estimated from related benchmarks

Vision benchmarks

Rank among models with a published score, and the leaderboard around each model. ~ italic = no published score, estimated from related benchmarks.

Metric
Gemini 3.8 Flash
Grok 4.6
Step 5 Preview
MMMU
day 0
~#2/3~71.3%Estimated
  1. #1Claude Haiku 4.573.2%
  2. ~#2Gemini 3.8 FlashEstimated71.3%
  3. #2Llama 4 Maverick69.4%
estimated from related benchmarks
~#2/3~71.3%Estimated
  1. #1Claude Haiku 4.573.2%
  2. ~#2Grok 4.6Estimated71.3%
  3. #2Llama 4 Maverick69.4%
estimated from related benchmarks
~#2/3~71.3%Estimated
  1. #1Claude Haiku 4.573.2%
  2. ~#2Step 5 PreviewEstimated71.3%
  3. #2Llama 4 Maverick69.4%
estimated from related benchmarks
MMMU-Pro
day 0
#3/7685.6%BestVerified
  1. #1Claude Opus 5.587.7%
  2. #2GPT-6 Astra86.9%
  3. #3Gemini 3.8 Flash85.6%
  4. #4Claude Opus 584.7%
artificialanalysis.ai · 2026-09-24
~#10/77~81.5%Estimated
  1. #1Claude Opus 5.587.7%
  2. #9Intern-S2-397B81.7%
  3. ~#10Grok 4.6Estimated81.5%
  4. #10GPT-5.6 Terra80.7%
estimated from related benchmarks
#25/7676.4%Verified
  1. #1Claude Opus 5.587.7%
  2. #24Grok Build 0.1 061676.5%
  3. #25Step 5 Preview76.4%
  4. #26Qwen3.8 27B76.3%
artificialanalysis.ai · 2026-09-24
CharXiv Reasoning
day 0
#1/886.2%Lab-reported
  1. #1Gemini 3.8 Flash86.2%
  2. #2Kimi K384.8%
deepmind.google · 2026-09-02
~#5/9~81.8%Estimated
  1. #1Gemini 3.8 Flash86.2%
  2. #4Qwen3.8-Omni-Flash83.5%
  3. ~#5Grok 4.6Estimated81.8%
  4. #5Muse Glimmer78.8%
estimated from related benchmarks
~#5/9~81.3%Estimated
  1. #1Gemini 3.8 Flash86.2%
  2. #4Qwen3.8-Omni-Flash83.5%
  3. ~#5Step 5 PreviewEstimated81.3%
  4. #5Muse Glimmer78.8%
estimated from related benchmarks
OmniDocBench v1.5
third-party
~#4/8~89.9%Estimated
  1. #1MiniMax-M391.6%
  2. #2Qwen3.8 27B91.1%
  3. ~#4Gemini 3.8 FlashEstimated89.9%
  4. #4Gemini 3.1 Pro85.3%
estimated from related benchmarks
~#4/8~88.2%Estimated
  1. #1MiniMax-M391.6%
  2. #2Qwen3.8 27B91.1%
  3. ~#4Grok 4.6Estimated88.2%
  4. #4Gemini 3.1 Pro85.3%
estimated from related benchmarks
~#4/8~88.1%Estimated
  1. #1MiniMax-M391.6%
  2. #2Qwen3.8 27B91.1%
  3. ~#4Step 5 PreviewEstimated88.1%
  4. #4Gemini 3.1 Pro85.3%
estimated from related benchmarks
GDP.pdf (AA)
third-party
#11/4221.0%BestVerified
  1. #1GPT-6 Astra31.0%
  2. #10GPT-5.521.2%
  3. #11Gemini 3.8 Flash21.0%
  4. #12GPT-6 Luna20.4%
artificialanalysis.ai · 2026-09-24
#16/4217.2%Verified
  1. #1GPT-6 Astra31.0%
  2. #15Gemini 3.1 Pro17.8%
  3. #16Grok 4.617.2%
  4. #17Qwen3.8 27B16.6%
artificialanalysis.ai · 2026-09-24
#20/4214.8%Verified
  1. #1GPT-6 Astra31.0%
  2. #19GLM-5.3 Flash15.4%
  3. #20Step 5 Preview14.8%
  4. #21Gemini 3.5 Flash-Lite13.6%
artificialanalysis.ai · 2026-09-24
Chartography
third-party
#5/2240.9%BestVerified
  1. #1GPT-6 Astra71.0%
  2. #4Claude Fable 5.146.2%
  3. #5Gemini 3.8 Flash40.9%
  4. #6GPT-5.6 Terra34.0%
surgehq.ai · 2026-09-24
#14/2220.5%Verified
  1. #1GPT-6 Astra71.0%
  2. #13Gemini 3.1 Pro26.1%
  3. #14Grok 4.620.5%
  4. #15Muse Glimmer17.2%
surgehq.ai · 2026-09-24
~#14/23~25.1%Estimated
  1. #1GPT-6 Astra71.0%
  2. #13Gemini 3.1 Pro26.1%
  3. ~#14Step 5 PreviewEstimated25.1%
  4. #14Grok 4.620.5%
estimated from related benchmarks

Hard reasoning benchmarks

Rank among models with a published score, and the leaderboard around each model. ~ italic = no published score, estimated from related benchmarks.

Metric
Gemini 3.8 Flash
Grok 4.6
Step 5 Preview
GPQA Diamond
day 0
#2/17295.3%BestVerified
  1. #1GPT-6 Astra96.1%
  2. #2Gemini 3.8 Flash95.3%
  3. #3Gemini 3.1 Pro94.1%
artificialanalysis.ai · 2026-09-24
#5/17293.5%Verified
  1. #1GPT-6 Astra96.1%
  2. #5GPT-5.593.5%
  3. #5Grok 4.693.5%
  4. #5Kimi K393.5%
artificialanalysis.ai · 2026-09-24
#5/17293.5%Lab-reported
  1. #1GPT-6 Astra96.1%
  2. #5Qwen3.8 2.4T A95B93.5%
  3. #5Step 5 Preview93.5%
  4. #11Claude Opus 593.2%
stepfun.com · 2026-09-20
Humanity's Last Exam
day 0
#9/17847.8%BestVerified
  1. #1Claude Opus 5.561.4%
  2. #8GPT-6 Sol47.9%
  3. #9Gemini 3.8 Flash47.8%
  4. #10Gemini 3.1 Pro47.0%
artificialanalysis.ai · 2026-09-24
#14/17844.1%Verified
  1. #1Claude Opus 5.561.4%
  2. #13GPT-5.545.8%
  3. #14Grok 4.644.1%
  4. #15Hy4 preview43.4%
artificialanalysis.ai · 2026-09-24
#12/17846.5%Verified
  1. #1Claude Opus 5.561.4%
  2. #11Kimi K346.9%
  3. #12Step 5 Preview46.5%
  4. #13GPT-5.545.8%
artificialanalysis.ai · 2026-09-24
AIME (latest)
day 0
~#2/25~96.8%Estimated
  1. #1Inkling97.1%
  2. ~#2Gemini 3.8 FlashEstimated96.8%
  3. #2Muse Glimmer94.7%
estimated from related benchmarks
~#2/25~96.8%Estimated
  1. #1Inkling97.1%
  2. ~#2Grok 4.6Estimated96.8%
  3. #2Muse Glimmer94.7%
estimated from related benchmarks
~#2/25~96.8%Estimated
  1. #1Inkling97.1%
  2. ~#2Step 5 PreviewEstimated96.8%
  3. #2Muse Glimmer94.7%
estimated from related benchmarks
AA Intelligence Index
third-party
#17/7440.9Verified
  1. #1Claude Opus 5.557.6
  2. #16GLM-5.3 Flash41.8
  3. #17Gemini 3.8 Flash40.9
  4. #18Qwen3.8 2.4T A95B39.9
artificialanalysis.ai · 2026-09-24
#12/7444.2BestVerified
  1. #1Claude Opus 5.557.6
  2. #11GLM-5.344.8
  3. #12Grok 4.644.2
  4. #13Step 5 Preview43.7
artificialanalysis.ai · 2026-09-24
#13/7443.7Verified
  1. #1Claude Opus 5.557.6
  2. #12Grok 4.644.2
  3. #13Step 5 Preview43.7
  4. #14Kimi K343.6
artificialanalysis.ai · 2026-09-24

Agents benchmarks

Rank among models with a published score, and the leaderboard around each model. ~ italic = no published score, estimated from related benchmarks.

Metric
Gemini 3.8 Flash
Grok 4.6
Step 5 Preview
τ²-bench (Telecom)
day 0
~#2/116~98.3%Estimated
  1. #1Step 3.7 Flash98.5%
  2. ~#2Gemini 3.8 FlashEstimated98.3%
  3. #2Gemini 3.1 Pro95.6%
estimated from related benchmarks
~#2/116~97.7%Estimated
  1. #1Step 3.7 Flash98.5%
  2. ~#2Grok 4.6Estimated97.7%
  3. #2Gemini 3.1 Pro95.6%
estimated from related benchmarks
~#2/116~98.1%Estimated
  1. #1Step 3.7 Flash98.5%
  2. ~#2Step 5 PreviewEstimated98.1%
  3. #2Gemini 3.1 Pro95.6%
estimated from related benchmarks
OSWorld-Verified
day 0
~#4/12~82.0%Estimated
  1. #1Kimi K384.8%
  2. #3Nex-N2.5-Pro82.2%
  3. ~#4Gemini 3.8 FlashEstimated82.0%
  4. #4MiMo-V2.6-Pro82.0%
estimated from related benchmarks
~#3/12~82.4%Estimated
  1. #1Kimi K384.8%
  2. #2Qwen3.8 27B84.3%
  3. ~#3Grok 4.6Estimated82.4%
  4. #3Nex-N2.5-Pro82.2%
estimated from related benchmarks
~#3/12~82.3%Estimated
  1. #1Kimi K384.8%
  2. #2Qwen3.8 27B84.3%
  3. ~#3Step 5 PreviewEstimated82.3%
  4. #3Nex-N2.5-Pro82.2%
estimated from related benchmarks
OSWorld 2.0
day 0
~#3/5~54.1%Estimated
  1. #1GLM-5.3 Flash59.1%
  2. #2Kimi K358.3%
  3. ~#3Gemini 3.8 FlashEstimated54.1%
  4. #3GPT-5.6 Terra50.2%
estimated from related benchmarks
~#3/5~56.6%Estimated
  1. #1GLM-5.3 Flash59.1%
  2. #2Kimi K358.3%
  3. ~#3Grok 4.6Estimated56.6%
  4. #3GPT-5.6 Terra50.2%
estimated from related benchmarks
~#3/5~53.8%Estimated
  1. #1GLM-5.3 Flash59.1%
  2. #2Kimi K358.3%
  3. ~#3Step 5 PreviewEstimated53.8%
  4. #3GPT-5.6 Terra50.2%
estimated from related benchmarks
BrowseComp
day 0
~#7/18~88.0%Estimated
  1. #1Atria Dawn Preview92.5%
  2. #6Step 5 Preview88.7%
  3. ~#7Gemini 3.8 FlashEstimated88.0%
  4. #7GPT-5.6 Terra87.5%
estimated from related benchmarks
~#6/18~89.6%Estimated
  1. #1Atria Dawn Preview92.5%
  2. #5Nex-N2.5-Pro89.7%
  3. ~#6Grok 4.6Estimated89.6%
  4. #6Step 5 Preview88.7%
estimated from related benchmarks
#6/1788.7%Lab-reported
  1. #1Atria Dawn Preview92.5%
  2. #5Nex-N2.5-Pro89.7%
  3. #6Step 5 Preview88.7%
  4. #7GPT-5.6 Terra87.5%
stepfun.com · 2026-09-20
GDPval-AA (Elo)
third-party
#21/861412Verified
  1. #1Claude Opus 5.51846
  2. #20GPT-5.6 Terra1432
  3. #21Gemini 3.8 Flash1412
  4. #22Qwen3.8 27B1409
artificialanalysis.ai · 2026-09-24
#10/861632BestVerified
  1. #1Claude Opus 5.51846
  2. #9GLM-5.3 Flash1641
  3. #10Grok 4.61632
  4. #11Qwen3.8 Flash-Next1612
artificialanalysis.ai · 2026-09-24
#14/861566Verified
  1. #1Claude Opus 5.51846
  2. #13Qwen3.8 2.4T A95B1597
  3. #14Step 5 Preview1566
  4. #15GPT-6 Astra1542
artificialanalysis.ai · 2026-09-24
AutomationBench-AA
third-party
#9/7959.9%Verified
  1. #1Claude Opus 5.569.5%
  2. #8GLM-5.3 Flash60.4%
  3. #9Gemini 3.8 Flash59.9%
  4. #10GPT-5.6 Terra59.6%
artificialanalysis.ai · 2026-09-24
#4/7967.0%BestVerified
  1. #1Claude Opus 5.569.5%
  2. #3GPT-6 Astra68.5%
  3. #4Grok 4.667.0%
  4. #5Grok 4.765.6%
artificialanalysis.ai · 2026-09-24
#21/7951.0%Verified
  1. #1Claude Opus 5.569.5%
  2. #20GPT-6 Luna53.2%
  3. #21Step 5 Preview51.0%
  4. #22Qwen3.8 27B48.2%
artificialanalysis.ai · 2026-09-24
τ-Bench Banking (AA)
third-party
#10/8844.9%BestVerified
  1. #1Muse Spark 1.350.5%
  2. #9Qwen3.8 Flash-Next45.4%
  3. #10Gemini 3.8 Flash44.9%
  4. #11Grok 4.643.3%
artificialanalysis.ai · 2026-09-24
#11/8843.3%Verified
  1. #1Muse Spark 1.350.5%
  2. #10Gemini 3.8 Flash44.9%
  3. #11Grok 4.643.3%
  4. #12Claude Opus 542.1%
artificialanalysis.ai · 2026-09-24
~#17/89~38.6%Estimated
  1. #1Muse Spark 1.350.5%
  2. #16GPT-5.539.0%
  3. ~#17Step 5 PreviewEstimated38.6%
  4. #17Claude Sonnet 537.3%
estimated from related benchmarks