Skip to content
Model Pareto

Compare models

Side by side: quality per category, price, speed, and every benchmark cell with where it came from. Pick up to four.
Claude Opus 5GLM-5.3 FlashQwen3.8 Max (0902)
Focus

Coding: quality vs price

Compared models are ringed; the other 100 ranked here are greyed.

Lower price is better. Pareto frontier: Granite 4.2 3B, NVIDIA Nemotron 3 Nano 30B A3B, gpt-oss-20b, Ling-3.0-flash-VL, MiMo-V2.6-Flash, GLM-5.3 Flash, DeepSeek V4.1 Flash, MiMo-V2.6-Pro, Claude Sonnet 5.5, Claude Opus 5.5. 26 models are not plotted: Xing4.0-29B-A4B, Nex-N2.5-Pro, Atria Dawn Preview, Intern-S2-397B, Solar Open2 250B, Phi-4-reasoning-plus, Motif 3, Nex-N2-Pro, Nex-N2.5-Mini, A.X-K2, K2 Horizon 375B A23B, K-EXAONE 2.0 0803, K2 Horizon MoVA 36B A4B, Intern-S2-Preview (35B-A3B), Command A+, North Mini Code, G9v3-39A5B, Falcon-H1-34B-Instruct, Devstral 2, K2 Horizon 7B, Devstral Small 2, MiniCPM5-2B, Ling 3.0 Tiny, K2 Horizon 3.7B, K2 Horizon 0.9B, LFM2.5-2.6B.

26 models with no price data — shown in the strip at the left edge

Xing4.0-29B-A4B, Nex-N2.5-Pro, Atria Dawn Preview, Intern-S2-397B, Solar Open2 250B, Phi-4-reasoning-plus, Motif 3, Nex-N2-Pro, Nex-N2.5-Mini, A.X-K2, K2 Horizon 375B A23B, K-EXAONE 2.0 0803, K2 Horizon MoVA 36B A4B, Intern-S2-Preview (35B-A3B), Command A+, North Mini Code, G9v3-39A5B, Falcon-H1-34B-Instruct, Devstral 2, K2 Horizon 7B, Devstral Small 2, MiniCPM5-2B, Ling 3.0 Tiny, K2 Horizon 3.7B, K2 Horizon 0.9B, LFM2.5-2.6B

  • Best-value frontier (nothing is both cheaper and better)
  • Evidencestrong → weak
  • Estimated from other categories
  • Claude Opus 5
    Quality
    83.3
    Rank
    #5/103
    Price
    $10.0/M tok
    Speed
    54tok/s
    In$5.00Out$25/M tok

    vs GLM-5.3 Flash: +17.4 quality · 42× price

  • GLM-5.3 Flash
    Quality
    65.9
    Rank
    #15/103
    Price
    $0.24/M tok
    Speed
    46tok/s
    In$0.15▾Out$0.50▾/M tok

    vs Claude Opus 5: −17.4 quality · 0.02× price

  • Qwen3.8 Max (0902)
    Quality
    59.1
    Rank
    #24/103
    Price
    $3.00/M tok
    Speed
    39tok/s
    In$2.00Out$6.00/M tok

    vs Claude Opus 5: −24.2 quality · 0.3× price

Overview

Metric
Claude Opus 5
GLM-5.3 Flash
Qwen3.8 Max (0902)
Lab
Anthropic
Z.ai (Zhipu)
Alibaba Qwen
Released
Jul 24, 2026
Aug 26, 2026
Sep 2, 2026
Weights
Proprietary
Open
Proprietary
Input price
$/M tok
$5.00
$0.15Best
$2.00
Output price
$/M tok
$25
$0.50Best
$6.00
Blended price
$/M tok · 3:1 in:out
$10
$0.237Best
$3.00
Output speed
tok/s
54Best
46
39
Context
tokens
1MBest
1MBest
1MBest

Quality by category

0–100 within each category (100 = best tracked model). Rank is among all models ranked there. Click a row to focus it.

Metric
Claude Opus 5
GLM-5.3 Flash
Qwen3.8 Max (0902)
Coding
83.3±3.2Best
#5/103Mixed
65.9±6.4
#15/103Mixedbest value
59.1±4.5
#24/103Verified
Writing & chat
93.4±4.3Best
#2/146Verifiedbest value
78.4±6.0
#14/146Verified
82.4±6.0
#9/146Verified
Vision
77.4±4.8Best
#9/82Verified
62.1±7.3
#28/82Verified
77.4±4.8
#10/82Verified
Hard reasoning
91.7±3.7Best
#5/182Verified
77.9±3.7
#21/182Verifiedbest value
82.1±3.7
#13/182Verified
Agents
84.8±4.6
#8/173Mixed
85.5±5.1Best
#6/173Mixedbest value
85.2±5.8
#7/173Verified

Coding benchmarks

Rank among models with a published score, and the leaderboard around each model. ~ italic = no published score, estimated from related benchmarks.

Metric
Claude Opus 5
GLM-5.3 Flash
Qwen3.8 Max (0902)
SWE-bench Verified
day 0
#1/1396.0%Lab-reported
  1. #1Claude Opus 596.0%
  2. #2Claude Sonnet 585.2%
anthropic.com · 2026-07-24
~#3/14~84.6%Estimated
  1. #1Claude Opus 596.0%
  2. #2Claude Sonnet 585.2%
  3. ~#3GLM-5.3 FlashEstimated84.6%
  4. #3Gemini 3.1 Pro80.6%
estimated from related benchmarks
~#2/14~86.2%Estimated
  1. #1Claude Opus 596.0%
  2. ~#2Qwen3.8 Max (0902)Estimated86.2%
  3. #2Claude Sonnet 585.2%
estimated from related benchmarks
SWE-bench Pro (Public)
day 0
#4/1879.2%Lab-reported
  1. #1Claude Opus 5.589.9%
  2. #3Claude Fable 5.181.2%
  3. #4Claude Opus 579.2%
  4. #5Intern-S2-397B68.5%
anthropic.com · 2026-07-24
~#6/19~66.6%Estimated
  1. #1Claude Opus 5.589.9%
  2. #5Intern-S2-397B68.5%
  3. ~#6GLM-5.3 FlashEstimated66.6%
  4. #6Hy4 preview65.7%
estimated from related benchmarks
~#6/19~66.8%Estimated
  1. #1Claude Opus 5.589.9%
  2. #5Intern-S2-397B68.5%
  3. ~#6Qwen3.8 Max (0902)Estimated66.8%
  4. #6Hy4 preview65.7%
estimated from related benchmarks
DeepSWE v1.1
day 0
#20/3062.5%Verified
  1. #1DeepSeek V4.1 Flash74.2%
  2. #19GLM-5.3 Flash63.4%
  3. #20Claude Opus 562.5%
  4. #21GLM-5.361.4%
artificialanalysis.ai · 2026-09-24
#19/3063.4%BestLab-reported
  1. #1DeepSeek V4.1 Flash74.2%
  2. #18GPT-6 Luna63.7%
  3. #19GLM-5.3 Flash63.4%
  4. #20Claude Opus 562.5%
z.ai · 2026-08-26
#27/3051.0%Verified
  1. #1DeepSeek V4.1 Flash74.2%
  2. #26Nex-N2.5-Pro55.8%
  3. #27Qwen3.8 Max (0902)51.0%
  4. #28Qwen3.8 27B42.2%
artificialanalysis.ai · 2026-09-24
Terminal-Bench 4.0
day 0
#5/8349.0%BestVerified
  1. #1Claude Sonnet 5.563.6%
  2. #4Claude Fable 5.152.0%
  3. #5Claude Opus 549.0%
  4. #6GPT-6 Sol43.9%
artificialanalysis.ai · 2026-09-24
#13/8332.8%Verified
  1. #1Claude Sonnet 5.563.6%
  2. #11Step 5 Preview33.3%
  3. #13GLM-5.3 Flash32.8%
  4. #14DeepSeek V4.1 Flash26.8%
artificialanalysis.ai · 2026-09-24
#8/8338.9%Verified
  1. #1Claude Sonnet 5.563.6%
  2. #7GLM-5.341.9%
  3. #8Qwen3.8 Max (0902)38.9%
  4. #9GPT-5.6 Terra35.4%
artificialanalysis.ai · 2026-09-24
LiveCodeBench
third-party
~#3/20~91.3%Estimated
  1. #1Qwen3.8-Omni-Flash92.6%
  2. #2Qwen3.8 Flash-Next91.9%
  3. ~#3Claude Opus 5Estimated91.3%
  4. #3Qwen3.8 27B90.3%
estimated from related benchmarks
~#3/20~91.5%Estimated
  1. #1Qwen3.8-Omni-Flash92.6%
  2. #2Qwen3.8 Flash-Next91.9%
  3. ~#3GLM-5.3 FlashEstimated91.5%
  4. #3Qwen3.8 27B90.3%
estimated from related benchmarks
~#2/20~92.0%Estimated
  1. #1Qwen3.8-Omni-Flash92.6%
  2. ~#2Qwen3.8 Max (0902)Estimated92.0%
  3. #2Qwen3.8 Flash-Next91.9%
estimated from related benchmarks
SciCode
third-party
#14/9556.4%BestVerified
  1. #1Claude Opus 5.566.9%
  2. #13GPT-6 Astra56.5%
  3. #14Claude Opus 556.4%
  4. #15GPT-5.555.8%
artificialanalysis.ai · 2026-09-24
#25/9551.6%Verified
  1. #1Claude Opus 5.566.9%
  2. #24DeepSeek V4.1 Flash51.9%
  3. #25GLM-5.3 Flash51.6%
  4. #26MiMo-V2.6-Flash51.3%
artificialanalysis.ai · 2026-09-24
#22/9552.1%Verified
  1. #1Claude Opus 5.566.9%
  2. #22GPT-5.4 mini52.1%
  3. #22Qwen3.8 Max (0902)52.1%
  4. #24DeepSeek V4.1 Flash51.9%
artificialanalysis.ai · 2026-09-24
AA Coding Agent Index
third-party
#4/1459.7BestVerified
  1. #1Claude Opus 5.566.0
  2. #3GPT-6 Astra61.6
  3. #4Claude Opus 559.7
  4. #5GPT-6 Sol56.7
artificialanalysis.ai · 2026-09-24
~#10/15~49.0Estimated
  1. #1Claude Opus 5.566.0
  2. #9Kimi K351.9
  3. ~#10GLM-5.3 FlashEstimated49.0
  4. #10Grok 4.647.0
estimated from related benchmarks
#11/1443.3Verified
  1. #1Claude Opus 5.566.0
  2. #10Grok 4.647.0
  3. #11Qwen3.8 Max (0902)43.3
  4. #12DeepSeek V4 Pro (0813)43.1
artificialanalysis.ai · 2026-09-24
Benchmarks in other categories (4)

Writing & chat benchmarks

Rank among models with a published score, and the leaderboard around each model. ~ italic = no published score, estimated from related benchmarks.

Metric
Claude Opus 5
GLM-5.3 Flash
Qwen3.8 Max (0902)
IFBench
day 0
~#3/126~82.8%Estimated
  1. #1MiniMax-M382.9%
  2. #2Qwen3.8 2.4T A95B82.8%
  3. ~#3Claude Opus 5Estimated82.8%
  4. #3Qwen3.8-Omni-Flash81.5%
estimated from related benchmarks
~#17/126~75.8%Estimated
  1. #1MiniMax-M382.9%
  2. #15GPT-5.575.9%
  3. ~#17GLM-5.3 FlashEstimated75.8%
  4. #17Qwen3.5 122B A10B75.7%
estimated from related benchmarks
~#7/126~80.8%Estimated
  1. #1MiniMax-M382.9%
  2. #6Intern-S2-Preview (35B-A3B)80.9%
  3. ~#7Qwen3.8 Max (0902)Estimated80.8%
  4. #7Nemotron Cascade 2 30B A3B80.4%
estimated from related benchmarks
MMMLU
day 0
~#2/5~92.2%Estimated
  1. #1Gemini 3.1 Pro92.6%
  2. ~#2Claude Opus 5Estimated92.2%
  3. #2Gemma 4 31B88.4%
estimated from related benchmarks
~#2/5~90.7%Estimated
  1. #1Gemini 3.1 Pro92.6%
  2. ~#2GLM-5.3 FlashEstimated90.7%
  3. #2Gemma 4 31B88.4%
estimated from related benchmarks
~#2/5~91.3%Estimated
  1. #1Gemini 3.1 Pro92.6%
  2. ~#2Qwen3.8 Max (0902)Estimated91.3%
  3. #2Gemma 4 31B88.4%
estimated from related benchmarks
LMArena Text, Non-English (Elo)
third-party
#4/531483BestVerified
  1. #1Claude Opus 5.51501
  2. #3Muse Spark 1.3Few votes1487
  3. #4Claude Opus 51483
  4. #4Gemini 3.8 FlashFew votes1483
lmarena.ai · 2026-09-25
#11/531463Verified
  1. #1Claude Opus 5.51501
  2. #10GLM-5.31466
  3. #11GLM-5.3 Flash1463
  4. #12DeepSeek V4.1 Flash1462
lmarena.ai · 2026-09-24
#9/531467Verified
  1. #1Claude Opus 5.51501
  2. #8GPT-5.51474
  3. #9Qwen3.8 Max (0902)1467
  4. #10GLM-5.31466
lmarena.ai · 2026-09-25
LMArena Text (Elo)
third-party
#3/531493BestVerified
  1. #1Claude Opus 5.51509
  2. #2Claude Fable 5.11501
  3. #3Claude Opus 51493
  4. #3Gemini 3.8 Flash1493
lmarena.ai · 2026-09-24
#14/531475Verified
  1. #1Claude Opus 5.51509
  2. #13DeepSeek V4.1 Flash1477
  3. #14GLM-5.3 Flash1475
  4. #15GPT-5.6 Terra1466
lmarena.ai · 2026-09-24
#9/531481Verified
  1. #1Claude Opus 5.51509
  2. #8GPT-5.51482
  3. #9Qwen3.8 Max (0902)1481
  4. #10GLM-5.31480
lmarena.ai · 2026-09-24
EQ-Bench Creative Writing v3 (Elo)
third-party
#3/252133Verified
  1. #1GPT-6 Astra2173
  2. #2Claude Fable 5.12162
  3. #3Claude Opus 52133
  4. #4GPT-6 Sol2125
eqbench.com · 2026-09-24
~#9/26~1921Estimated
  1. #1GPT-6 Astra2173
  2. #8Grok 4.72007
  3. ~#9GLM-5.3 FlashEstimated1921
  4. #9Muse Spark 1.31906
estimated from related benchmarks
~#9/26~1958Estimated
  1. #1GPT-6 Astra2173
  2. #8Grok 4.72007
  3. ~#9Qwen3.8 Max (0902)Estimated1958
  4. #9Muse Spark 1.31906
estimated from related benchmarks

Vision benchmarks

Rank among models with a published score, and the leaderboard around each model. ~ italic = no published score, estimated from related benchmarks.

Metric
Claude Opus 5
GLM-5.3 Flash
Qwen3.8 Max (0902)
MMMU
day 0
~#2/3~71.3%Estimated
  1. #1Claude Haiku 4.573.2%
  2. ~#2Claude Opus 5Estimated71.3%
  3. #2Llama 4 Maverick69.4%
estimated from related benchmarks
~#2/3~71.3%Estimated
  1. #1Claude Haiku 4.573.2%
  2. ~#2GLM-5.3 FlashEstimated71.3%
  3. #2Llama 4 Maverick69.4%
estimated from related benchmarks
~#2/3~71.3%Estimated
  1. #1Claude Haiku 4.573.2%
  2. ~#2Qwen3.8 Max (0902)Estimated71.3%
  3. #2Llama 4 Maverick69.4%
estimated from related benchmarks
MMMU-Pro
day 0
#4/7684.7%BestVerified
  1. #1Claude Opus 5.587.7%
  2. #3Gemini 3.8 Flash85.6%
  3. #4Claude Opus 584.7%
  4. #5GPT-6 Sol83.3%
artificialanalysis.ai · 2026-09-24
~#7/77~82.5%Estimated
  1. #1Claude Opus 5.587.7%
  2. #6Qwen3.8 Max (0902)82.8%
  3. ~#7GLM-5.3 FlashEstimated82.5%
  4. #7Gemini 3.1 Pro82.4%
estimated from related benchmarks
#6/7682.8%Verified
  1. #1Claude Opus 5.587.7%
  2. #5GPT-6 Sol83.3%
  3. #6Qwen3.8 Max (0902)82.8%
  4. #7Gemini 3.1 Pro82.4%
artificialanalysis.ai · 2026-09-24
CharXiv Reasoning
day 0
~#2/9~84.9%Estimated
  1. #1Gemini 3.8 Flash86.2%
  2. ~#2Claude Opus 5Estimated84.9%
  3. #2Kimi K384.8%
estimated from related benchmarks
~#5/9~81.3%Estimated
  1. #1Gemini 3.8 Flash86.2%
  2. #4Qwen3.8-Omni-Flash83.5%
  3. ~#5GLM-5.3 FlashEstimated81.3%
  4. #5Muse Glimmer78.8%
estimated from related benchmarks
~#4/9~84.1%Estimated
  1. #1Gemini 3.8 Flash86.2%
  2. #3Qwen3.8 Flash-Next84.6%
  3. ~#4Qwen3.8 Max (0902)Estimated84.1%
  4. #4Qwen3.8-Omni-Flash83.5%
estimated from related benchmarks
OmniDocBench v1.5
third-party
~#4/8~90.7%Estimated
  1. #1MiniMax-M391.6%
  2. #2Qwen3.8 27B91.1%
  3. ~#4Claude Opus 5Estimated90.7%
  4. #4Gemini 3.1 Pro85.3%
estimated from related benchmarks
~#4/8~87.5%Estimated
  1. #1MiniMax-M391.6%
  2. #2Qwen3.8 27B91.1%
  3. ~#4GLM-5.3 FlashEstimated87.5%
  4. #4Gemini 3.1 Pro85.3%
estimated from related benchmarks
~#4/8~90.7%Estimated
  1. #1MiniMax-M391.6%
  2. #2Qwen3.8 27B91.1%
  3. ~#4Qwen3.8 Max (0902)Estimated90.7%
  4. #4Gemini 3.1 Pro85.3%
estimated from related benchmarks
GDP.pdf (AA)
third-party
#9/4221.6%Verified
  1. #1GPT-6 Astra31.0%
  2. #8Kimi K322.0%
  3. #9Claude Opus 521.6%
  4. #10GPT-5.521.2%
artificialanalysis.ai · 2026-09-24
#19/4215.4%Verified
  1. #1GPT-6 Astra31.0%
  2. #18Qwen3.8 Flash-Next15.6%
  3. #19GLM-5.3 Flash15.4%
  4. #20Step 5 Preview14.8%
artificialanalysis.ai · 2026-09-24
#7/4222.8%BestVerified
  1. #1GPT-6 Astra31.0%
  2. #6GPT-5.6 Terra24.0%
  3. #7Qwen3.8 Max (0902)22.8%
  4. #8Kimi K322.0%
artificialanalysis.ai · 2026-09-24
Chartography
third-party
#11/2227.3%Verified
  1. #1GPT-6 Astra71.0%
  2. #10Muse Spark 1.327.6%
  3. #11Claude Opus 527.3%
  4. #12Kimi K326.6%
surgehq.ai · 2026-09-24
#17/2216.3%Verified
  1. #1GPT-6 Astra71.0%
  2. #16Claude Sonnet 516.6%
  3. #17GLM-5.3 Flash16.3%
  4. #18Grok 4.714.7%
surgehq.ai · 2026-09-24
#8/2229.1%BestVerified
  1. #1GPT-6 Astra71.0%
  2. #8GPT-6 Luna29.1%
  3. #8Qwen3.8 Max (0902)29.1%
  4. #10Muse Spark 1.327.6%
surgehq.ai · 2026-09-24

Hard reasoning benchmarks

Rank among models with a published score, and the leaderboard around each model. ~ italic = no published score, estimated from related benchmarks.

Metric
Claude Opus 5
GLM-5.3 Flash
Qwen3.8 Max (0902)
GPQA Diamond
day 0
#11/17293.2%BestVerified
  1. #1GPT-6 Astra96.1%
  2. #5Step 5 Preview93.5%
  3. #11Claude Opus 593.2%
  4. #12MiniMax-M392.9%
artificialanalysis.ai · 2026-09-24
#20/17291.2%Verified
  1. #1GPT-6 Astra96.1%
  2. #19GPT-5.3 Codex91.5%
  3. #20GLM-5.3 Flash91.2%
  4. #21Claude Sonnet 591.1%
artificialanalysis.ai · 2026-09-24
#13/17292.8%Verified
  1. #1GPT-6 Astra96.1%
  2. #13DeepSeek V4 Pro (0813)92.8%
  3. #13Qwen3.8 Max (0902)92.8%
  4. #15GPT-5.6 Terra92.5%
artificialanalysis.ai · 2026-09-24
Humanity's Last Exam
day 0
#4/17854.9%BestVerified
  1. #1Claude Opus 5.561.4%
  2. #3Claude Sonnet 5.555.0%
  3. #4Claude Opus 554.9%
  4. #5GPT-6 Astra54.7%
artificialanalysis.ai · 2026-09-24
#24/17839.9%Verified
  1. #1Claude Opus 5.561.4%
  2. #23DeepSeek V4 Pro (0813)41.0%
  3. #24GLM-5.3 Flash39.9%
  4. #25DeepSeek V4.1 Flash39.2%
artificialanalysis.ai · 2026-09-24
#16/17843.1%Verified
  1. #1Claude Opus 5.561.4%
  2. #16Grok 4.743.1%
  3. #16Qwen3.8 Max (0902)43.1%
  4. #18GPT-5.6 Terra42.9%
artificialanalysis.ai · 2026-09-24
AIME (latest)
day 0
~#2/25~96.9%Estimated
  1. #1Inkling97.1%
  2. ~#2Claude Opus 5Estimated96.9%
  3. #2Muse Glimmer94.7%
estimated from related benchmarks
~#2/25~96.7%Estimated
  1. #1Inkling97.1%
  2. ~#2GLM-5.3 FlashEstimated96.7%
  3. #2Muse Glimmer94.7%
estimated from related benchmarks
~#2/25~96.8%Estimated
  1. #1Inkling97.1%
  2. ~#2Qwen3.8 Max (0902)Estimated96.8%
  3. #2Muse Glimmer94.7%
estimated from related benchmarks
AA Intelligence Index
third-party
#5/7450.8BestVerified
  1. #1Claude Opus 5.557.6
  2. #4GPT-6 Astra52.7
  3. #5Claude Opus 550.8
  4. #6Muse Spark 1.348.1
artificialanalysis.ai · 2026-09-24
#16/7441.8Verified
  1. #1Claude Opus 5.557.6
  2. #15GPT-5.6 Terra42.1
  3. #16GLM-5.3 Flash41.8
  4. #17Gemini 3.8 Flash40.9
artificialanalysis.ai · 2026-09-24
#10/7445.4Verified
  1. #1Claude Opus 5.557.6
  2. #9MiMo-V2.6-Pro46.3
  3. #10Qwen3.8 Max (0902)45.4
  4. #11GLM-5.344.8
artificialanalysis.ai · 2026-09-24

Agents benchmarks

Rank among models with a published score, and the leaderboard around each model. ~ italic = no published score, estimated from related benchmarks.

Metric
Claude Opus 5
GLM-5.3 Flash
Qwen3.8 Max (0902)
τ²-bench (Telecom)
day 0
~#2/116~98.3%Estimated
  1. #1Step 3.7 Flash98.5%
  2. ~#2Claude Opus 5Estimated98.3%
  3. #2Gemini 3.1 Pro95.6%
estimated from related benchmarks
~#2/116~97.4%Estimated
  1. #1Step 3.7 Flash98.5%
  2. ~#2GLM-5.3 FlashEstimated97.4%
  3. #2Gemini 3.1 Pro95.6%
estimated from related benchmarks
~#2/116~98.3%Estimated
  1. #1Step 3.7 Flash98.5%
  2. ~#2Qwen3.8 Max (0902)Estimated98.3%
  3. #2Gemini 3.1 Pro95.6%
estimated from related benchmarks
OSWorld-Verified
day 0
~#3/12~84.0%Estimated
  1. #1Kimi K384.8%
  2. #2Qwen3.8 27B84.3%
  3. ~#3Claude Opus 5Estimated84.0%
  4. #3Nex-N2.5-Pro82.2%
estimated from related benchmarks
~#3/12~82.9%Estimated
  1. #1Kimi K384.8%
  2. #2Qwen3.8 27B84.3%
  3. ~#3GLM-5.3 FlashEstimated82.9%
  4. #3Nex-N2.5-Pro82.2%
estimated from related benchmarks
~#3/12~83.5%Estimated
  1. #1Kimi K384.8%
  2. #2Qwen3.8 27B84.3%
  3. ~#3Qwen3.8 Max (0902)Estimated83.5%
  4. #3Nex-N2.5-Pro82.2%
estimated from related benchmarks
OSWorld 2.0
day 0
~#3/5~55.3%Estimated
  1. #1GLM-5.3 Flash59.1%
  2. #2Kimi K358.3%
  3. ~#3Claude Opus 5Estimated55.3%
  4. #3GPT-5.6 Terra50.2%
estimated from related benchmarks
#1/459.1%Lab-reported
  1. #1GLM-5.3 Flash59.1%
  2. #2Kimi K358.3%
z.ai · 2026-08-26
~#3/5~57.5%Estimated
  1. #1GLM-5.3 Flash59.1%
  2. #2Kimi K358.3%
  3. ~#3Qwen3.8 Max (0902)Estimated57.5%
  4. #3GPT-5.6 Terra50.2%
estimated from related benchmarks
BrowseComp
day 0
#4/1790.8%Lab-reported
  1. #1Atria Dawn Preview92.5%
  2. #3Kimi K391.2%
  3. #4Claude Opus 590.8%
  4. #5Nex-N2.5-Pro89.7%
anthropic.com · 2026-07-24
~#5/18~89.8%Estimated
  1. #1Atria Dawn Preview92.5%
  2. #4Claude Opus 590.8%
  3. ~#5GLM-5.3 FlashEstimated89.8%
  4. #5Nex-N2.5-Pro89.7%
estimated from related benchmarks
~#5/18~90.2%Estimated
  1. #1Atria Dawn Preview92.5%
  2. #4Claude Opus 590.8%
  3. ~#5Qwen3.8 Max (0902)Estimated90.2%
  4. #5Nex-N2.5-Pro89.7%
estimated from related benchmarks
GDPval-AA (Elo)
third-party
#3/861708BestVerified
  1. #1Claude Opus 5.51846
  2. #2Claude Fable 5.11735
  3. #3Claude Opus 51708
  4. #4Grok 4.71695
artificialanalysis.ai · 2026-09-24
#9/861641Verified
  1. #1Claude Opus 5.51846
  2. #8GLM-5.31646
  3. #9GLM-5.3 Flash1641
  4. #10Grok 4.61632
artificialanalysis.ai · 2026-09-24
#7/861668Verified
  1. #1Claude Opus 5.51846
  2. #6MiMo-V2.6-Pro1673
  3. #7Qwen3.8 Max (0902)1668
  4. #8GLM-5.31646
artificialanalysis.ai · 2026-09-24
AutomationBench-AA
third-party
#17/7956.6%Verified
  1. #1Claude Opus 5.569.5%
  2. #16DeepSeek V4 Pro (0813)56.7%
  3. #17Claude Opus 556.6%
  4. #18Qwen3.8 Max (0902)56.2%
artificialanalysis.ai · 2026-09-24
#8/7960.4%BestVerified
  1. #1Claude Opus 5.569.5%
  2. #7GPT-6 Sol61.6%
  3. #8GLM-5.3 Flash60.4%
  4. #9Gemini 3.8 Flash59.9%
artificialanalysis.ai · 2026-09-24
#18/7956.2%Verified
  1. #1Claude Opus 5.569.5%
  2. #17Claude Opus 556.6%
  3. #18Qwen3.8 Max (0902)56.2%
  4. #19Qwen3.8 Flash-Next55.9%
artificialanalysis.ai · 2026-09-24
τ-Bench Banking (AA)
third-party
#12/8842.1%Verified
  1. #1Muse Spark 1.350.5%
  2. #11Grok 4.643.3%
  3. #12Claude Opus 542.1%
  4. #13GPT-6 Astra41.4%
artificialanalysis.ai · 2026-09-24
#6/8847.2%Verified
  1. #1Muse Spark 1.350.5%
  2. #6Claude Fable 5.147.2%
  3. #6GLM-5.3 Flash47.2%
  4. #8Kimi K346.0%
artificialanalysis.ai · 2026-09-24
#5/8847.8%BestVerified
  1. #1Muse Spark 1.350.5%
  2. #4Qwen3.8 27B48.0%
  3. #5Qwen3.8 Max (0902)47.8%
  4. #6Claude Fable 5.147.2%
artificialanalysis.ai · 2026-09-24
Not comparable across labs (1)
OSWorld 2.0 (Sept 2026 release)
day 0
#3/374.0%Lab-reported
  1. #1Claude Opus 5.581.8%
  2. #2Claude Fable 5.180.7%
  3. #3Claude Opus 574.0%
anthropic.com · 2026-09-22
—
—