Skip to content
Model Pareto

Compare models

Side by side: quality per category, price, speed, and every benchmark cell with where it came from. Pick up to four.
GLM-5.3Grok 4.7Muse Spark 1.3
Focus

Coding: quality vs price

Compared models are ringed; the other 100 ranked here are greyed.

Lower price is better. Pareto frontier: Granite 4.2 3B, NVIDIA Nemotron 3 Nano 30B A3B, gpt-oss-20b, Ling-3.0-flash-VL, MiMo-V2.6-Flash, GLM-5.3 Flash, DeepSeek V4.1 Flash, MiMo-V2.6-Pro, Claude Sonnet 5.5, Claude Opus 5.5. 26 models are not plotted: Xing4.0-29B-A4B, Nex-N2.5-Pro, Atria Dawn Preview, Intern-S2-397B, Solar Open2 250B, Phi-4-reasoning-plus, Motif 3, Nex-N2-Pro, Nex-N2.5-Mini, A.X-K2, K2 Horizon 375B A23B, K-EXAONE 2.0 0803, K2 Horizon MoVA 36B A4B, Intern-S2-Preview (35B-A3B), Command A+, North Mini Code, G9v3-39A5B, Falcon-H1-34B-Instruct, Devstral 2, K2 Horizon 7B, Devstral Small 2, MiniCPM5-2B, Ling 3.0 Tiny, K2 Horizon 3.7B, K2 Horizon 0.9B, LFM2.5-2.6B.

26 models with no price data — shown in the strip at the left edge

Xing4.0-29B-A4B, Nex-N2.5-Pro, Atria Dawn Preview, Intern-S2-397B, Solar Open2 250B, Phi-4-reasoning-plus, Motif 3, Nex-N2-Pro, Nex-N2.5-Mini, A.X-K2, K2 Horizon 375B A23B, K-EXAONE 2.0 0803, K2 Horizon MoVA 36B A4B, Intern-S2-Preview (35B-A3B), Command A+, North Mini Code, G9v3-39A5B, Falcon-H1-34B-Instruct, Devstral 2, K2 Horizon 7B, Devstral Small 2, MiniCPM5-2B, Ling 3.0 Tiny, K2 Horizon 3.7B, K2 Horizon 0.9B, LFM2.5-2.6B

  • Best-value frontier (nothing is both cheaper and better)
  • Evidencestrong → weak
  • Estimated from other categories
  • GLM-5.3
    Quality
    74.0
    Rank
    #9/103
    Price
    $2.15/M tok
    Speed
    57tok/s
    In$1.40Out$4.40/M tok

    vs Muse Spark 1.3: −0.8 quality · 1.1× price

  • Grok 4.7
    Quality
    72.7
    Rank
    #11/103
    Price
    $3.00/M tok
    Speed
    40tok/s
    In$2.00Out$6.00/M tok

    vs Muse Spark 1.3: −2.1 quality · 1.5× price

  • Muse Spark 1.3
    Quality
    74.9
    Rank
    #8/103
    Price
    $2.00/M tok
    Speed
    219tok/s
    In$1.25▾Out$4.25▾/M tok

    vs GLM-5.3: +0.8 quality · 0.93× price

Overview

Metric
GLM-5.3
Grok 4.7
Muse Spark 1.3
Lab
Z.ai (Zhipu)
SpaceXAI (xAI)
Meta
Released
Aug 14, 2026
Sep 21, 2026
Sep 2, 2026
Weights
Open
Proprietary
Proprietary
Input price
$/M tok
$1.40
$2.00
$1.25Best
Output price
$/M tok
$4.40
$6.00
$4.25Best
Blended price
$/M tok · 3:1 in:out
$2.15
$3.00
$2.00Best
Output speed
tok/s
57
40
219Best
Context
tokens
1MBest
500K
1MBest

Quality by category

0–100 within each category (100 = best tracked model). Rank is among all models ranked there. Click a row to focus it.

Metric
GLM-5.3
Grok 4.7
Muse Spark 1.3
Coding
74.0±4.5
#9/103Verified
72.7±4.5
#11/103Verified
74.9±4.5Best
#8/103Verified
Writing & chat
86.0±4.3Best
#6/146Verifiedbest value
70.9±4.3
#25/146Verified
82.3±4.7
#10/146Verified
Vision
Not ranked
64.1±7.3
#23/82Verified
79.1±4.8Best
#6/82Verified
Hard reasoning
81.0±3.7
#15/182Verified
81.8±5.1
#14/182Verified
86.9±3.7Best
#6/182Verifiedbest value
Agents
87.4±5.8
#4/173Verified
86.7±7.8
#5/173Verified
87.4±5.8Best
#3/173Verifiedbest value

Coding benchmarks

Rank among models with a published score, and the leaderboard around each model. ~ italic = no published score, estimated from related benchmarks.

Metric
GLM-5.3
Grok 4.7
Muse Spark 1.3
SWE-bench Verified
day 0
~#2/14~89.7%Estimated
  1. #1Claude Opus 596.0%
  2. ~#2GLM-5.3Estimated89.7%
  3. #2Claude Sonnet 585.2%
estimated from related benchmarks
~#2/14~85.7%Estimated
  1. #1Claude Opus 596.0%
  2. ~#2Grok 4.7Estimated85.7%
  3. #2Claude Sonnet 585.2%
estimated from related benchmarks
~#2/14~88.2%Estimated
  1. #1Claude Opus 596.0%
  2. ~#2Muse Spark 1.3Estimated88.2%
  3. #2Claude Sonnet 585.2%
estimated from related benchmarks
SWE-bench Pro (Public)
day 0
~#5/19~71.3%Estimated
  1. #1Claude Opus 5.589.9%
  2. #4Claude Opus 579.2%
  3. ~#5GLM-5.3Estimated71.3%
  4. #5Intern-S2-397B68.5%
estimated from related benchmarks
~#6/19~68.1%Estimated
  1. #1Claude Opus 5.589.9%
  2. #5Intern-S2-397B68.5%
  3. ~#6Grok 4.7Estimated68.1%
  4. #6Hy4 preview65.7%
estimated from related benchmarks
~#5/19~70.5%Estimated
  1. #1Claude Opus 5.589.9%
  2. #4Claude Opus 579.2%
  3. ~#5Muse Spark 1.3Estimated70.5%
  4. #5Intern-S2-397B68.5%
estimated from related benchmarks
DeepSWE v1.1
day 0
#21/3061.4%Verified
  1. #1DeepSeek V4.1 Flash74.2%
  2. #20Claude Opus 562.5%
  3. #21GLM-5.361.4%
  4. #22Qwen3.8 Flash-Next58.7%
artificialanalysis.ai · 2026-09-24
#2/3072.6%BestVerified
  1. #1DeepSeek V4.1 Flash74.2%
  2. #2Grok 4.772.6%
  3. #3MiMo-V2.6-Pro71.9%
artificialanalysis.ai · 2026-09-24
#4/3071.7%Verified
  1. #1DeepSeek V4.1 Flash74.2%
  2. #3MiMo-V2.6-Pro71.9%
  3. #4Muse Spark 1.371.7%
  4. #5Claude Sonnet 5.571.0%
artificialanalysis.ai · 2026-09-24
Terminal-Bench 4.0
day 0
#7/8341.9%BestVerified
  1. #1Claude Sonnet 5.563.6%
  2. #6GPT-6 Sol43.9%
  3. #7GLM-5.341.9%
  4. #8Qwen3.8 Max (0902)38.9%
artificialanalysis.ai · 2026-09-24
#15/8325.8%Verified
  1. #1Claude Sonnet 5.563.6%
  2. #14DeepSeek V4.1 Flash26.8%
  3. #15Grok 4.725.8%
  4. #16Qwen3.8 Flash-Next25.3%
artificialanalysis.ai · 2026-09-24
#11/8333.3%Verified
  1. #1Claude Sonnet 5.563.6%
  2. #10MiMo-V2.6-Pro34.8%
  3. #11Muse Spark 1.333.3%
  4. #11Step 5 Preview33.3%
artificialanalysis.ai · 2026-09-24
LiveCodeBench
third-party
~#2/20~92.1%Estimated
  1. #1Qwen3.8-Omni-Flash92.6%
  2. ~#2GLM-5.3Estimated92.1%
  3. #2Qwen3.8 Flash-Next91.9%
estimated from related benchmarks
~#4/20~89.5%Estimated
  1. #1Qwen3.8-Omni-Flash92.6%
  2. #3Qwen3.8 27B90.3%
  3. ~#4Grok 4.7Estimated89.5%
  4. #4Nemotron 3 Ultra89.0%
estimated from related benchmarks
~#2/20~92.2%Estimated
  1. #1Qwen3.8-Omni-Flash92.6%
  2. ~#2Muse Spark 1.3Estimated92.2%
  3. #2Qwen3.8 Flash-Next91.9%
estimated from related benchmarks
SciCode
third-party
#6/9559.0%BestVerified
  1. #1Claude Opus 5.566.9%
  2. #5Kimi K359.5%
  3. #6GLM-5.359.0%
  4. #7Step 5 Preview58.9%
artificialanalysis.ai · 2026-09-24
#11/9557.4%Verified
  1. #1Claude Opus 5.566.9%
  2. #10GPT-6 Sol57.6%
  3. #11Grok 4.757.4%
  4. #12Gemini 3.8 Flash56.6%
artificialanalysis.ai · 2026-09-24
#8/9558.8%Verified
  1. #1Claude Opus 5.566.9%
  2. #7Step 5 Preview58.9%
  3. #8Muse Spark 1.358.8%
  4. #9Gemini 3.1 Pro58.7%
artificialanalysis.ai · 2026-09-24
AA Coding Agent Index
third-party
#8/1453.6Verified
  1. #1Claude Opus 5.566.0
  2. #7Muse Spark 1.354.3
  3. #8GLM-5.353.6
  4. #9Kimi K351.9
artificialanalysis.ai · 2026-09-24
#6/1456.3BestVerified
  1. #1Claude Opus 5.566.0
  2. #5GPT-6 Sol56.7
  3. #6Grok 4.756.3
  4. #7Muse Spark 1.354.3
artificialanalysis.ai · 2026-09-24
#7/1454.3Verified
  1. #1Claude Opus 5.566.0
  2. #6Grok 4.756.3
  3. #7Muse Spark 1.354.3
  4. #8GLM-5.353.6
artificialanalysis.ai · 2026-09-24
Benchmarks in other categories (4)

Writing & chat benchmarks

Rank among models with a published score, and the leaderboard around each model. ~ italic = no published score, estimated from related benchmarks.

Metric
GLM-5.3
Grok 4.7
Muse Spark 1.3
IFBench
day 0
~#3/126~81.7%Estimated
  1. #1MiniMax-M382.9%
  2. #2Qwen3.8 2.4T A95B82.8%
  3. ~#3GLM-5.3Estimated81.7%
  4. #3Qwen3.8-Omni-Flash81.5%
estimated from related benchmarks
~#21/126~73.8%Estimated
  1. #1MiniMax-M382.9%
  2. #20Command A+73.9%
  3. ~#21Grok 4.7Estimated73.8%
  4. #21GPT-5.4 mini73.3%
estimated from related benchmarks
~#3/126~82.8%Estimated
  1. #1MiniMax-M382.9%
  2. #2Qwen3.8 2.4T A95B82.8%
  3. ~#3Muse Spark 1.3Estimated82.8%
  4. #3Qwen3.8-Omni-Flash81.5%
estimated from related benchmarks
MMMLU
day 0
~#2/5~91.3%Estimated
  1. #1Gemini 3.1 Pro92.6%
  2. ~#2GLM-5.3Estimated91.3%
  3. #2Gemma 4 31B88.4%
estimated from related benchmarks
~#2/5~89.2%Estimated
  1. #1Gemini 3.1 Pro92.6%
  2. ~#2Grok 4.7Estimated89.2%
  3. #2Gemma 4 31B88.4%
estimated from related benchmarks
~#2/5~92.1%Estimated
  1. #1Gemini 3.1 Pro92.6%
  2. ~#2Muse Spark 1.3Estimated92.1%
  3. #2Gemma 4 31B88.4%
estimated from related benchmarks
LMArena Text, Non-English (Elo)
third-party
#10/531466Verified
  1. #1Claude Opus 5.51501
  2. #9Qwen3.8 Max (0902)1467
  3. #10GLM-5.31466
  4. #11GLM-5.3 Flash1463
lmarena.ai · 2026-09-24
#26/531435Verified
  1. #1Claude Opus 5.51501
  2. #25GPT-6 Luna1436
  3. #26Grok 4.71435
  4. #27Qwen3.5 397B A17B1434
lmarena.ai · 2026-09-25
#3/531487BestVerifiedFew votes
  1. #1Claude Opus 5.51501
  2. #2Claude Fable 5.1Few votes1496
  3. #3Muse Spark 1.3Few votes1487
  4. #4Claude Opus 51483
lmarena.ai · 2026-09-25
LMArena Text (Elo)
third-party
#10/531480Verified
  1. #1Claude Opus 5.51509
  2. #9Qwen3.8 Max (0902)1481
  3. #10GLM-5.31480
  4. #10GPT-6 AstraFew votes1480
lmarena.ai · 2026-09-25
#29/531439Verified
  1. #1Claude Opus 5.51509
  2. #28Inkling1440
  3. #29Grok 4.71439
  4. #30Gemma 4 26B A4B1438
lmarena.ai · 2026-09-25
#3/531493BestVerified
  1. #1Claude Opus 5.51509
  2. #3Gemini 3.8 Flash1493
  3. #3Muse Spark 1.31493
  4. #6Kimi K31488
lmarena.ai · 2026-09-24
EQ-Bench Creative Writing v3 (Elo)
third-party
#6/252075BestVerified
  1. #1GPT-6 Astra2173
  2. #5Kimi K32082
  3. #6GLM-5.32075
  4. #7Claude Opus 5.52050
eqbench.com · 2026-09-24
#8/252007Verified
  1. #1GPT-6 Astra2173
  2. #7Claude Opus 5.52050
  3. #8Grok 4.72007
  4. #9Muse Spark 1.31906
eqbench.com · 2026-09-24
#9/251906Verified
  1. #1GPT-6 Astra2173
  2. #8Grok 4.72007
  3. #9Muse Spark 1.31906
  4. #10GPT-5.6 Terra1855
eqbench.com · 2026-09-24

Vision benchmarks

Rank among models with a published score, and the leaderboard around each model. ~ italic = no published score, estimated from related benchmarks.

Metric
GLM-5.3
Grok 4.7
Muse Spark 1.3
MMMU
day 0
—
~#2/3~71.3%Estimated
  1. #1Claude Haiku 4.573.2%
  2. ~#2Grok 4.7Estimated71.3%
  3. #2Llama 4 Maverick69.4%
estimated from related benchmarks
~#2/3~71.3%Estimated
  1. #1Claude Haiku 4.573.2%
  2. ~#2Muse Spark 1.3Estimated71.3%
  3. #2Llama 4 Maverick69.4%
estimated from related benchmarks
MMMU-Pro
day 0
—
~#11/77~80.5%Estimated
  1. #1Claude Opus 5.587.7%
  2. #10GPT-5.6 Terra80.7%
  3. ~#11Grok 4.7Estimated80.5%
  4. #11Kimi K380.5%
estimated from related benchmarks
#8/7682.0%Verified
  1. #1Claude Opus 5.587.7%
  2. #7Gemini 3.1 Pro82.4%
  3. #8Muse Spark 1.382.0%
  4. #9Intern-S2-397B81.7%
artificialanalysis.ai · 2026-09-24
CharXiv Reasoning
day 0
—
~#5/9~81.4%Estimated
  1. #1Gemini 3.8 Flash86.2%
  2. #4Qwen3.8-Omni-Flash83.5%
  3. ~#5Grok 4.7Estimated81.4%
  4. #5Muse Glimmer78.8%
estimated from related benchmarks
~#4/9~84.1%Estimated
  1. #1Gemini 3.8 Flash86.2%
  2. #3Qwen3.8 Flash-Next84.6%
  3. ~#4Muse Spark 1.3Estimated84.1%
  4. #4Qwen3.8-Omni-Flash83.5%
estimated from related benchmarks
OmniDocBench v1.5
third-party
—
~#4/8~87.1%Estimated
  1. #1MiniMax-M391.6%
  2. #2Qwen3.8 27B91.1%
  3. ~#4Grok 4.7Estimated87.1%
  4. #4Gemini 3.1 Pro85.3%
estimated from related benchmarks
~#4/8~90.5%Estimated
  1. #1MiniMax-M391.6%
  2. #2Qwen3.8 27B91.1%
  3. ~#4Muse Spark 1.3Estimated90.5%
  4. #4Gemini 3.1 Pro85.3%
estimated from related benchmarks
GDP.pdf (AA)
third-party
—
#13/4220.0%Verified
  1. #1GPT-6 Astra31.0%
  2. #12GPT-6 Luna20.4%
  3. #13Grok 4.720.0%
  4. #14MiMo-V2.6-Pro19.2%
artificialanalysis.ai · 2026-09-24
#2/4226.6%BestVerified
  1. #1GPT-6 Astra31.0%
  2. #2Muse Spark 1.326.6%
  3. #3Claude Fable 5.126.2%
artificialanalysis.ai · 2026-09-24
Chartography
third-party
—
#18/2214.7%Verified
  1. #1GPT-6 Astra71.0%
  2. #17GLM-5.3 Flash16.3%
  3. #18Grok 4.714.7%
  4. #19DeepSeek V4.1 Flash11.6%
surgehq.ai · 2026-09-24
#10/2227.6%BestVerified
  1. #1GPT-6 Astra71.0%
  2. #8Qwen3.8 Max (0902)29.1%
  3. #10Muse Spark 1.327.6%
  4. #11Claude Opus 527.3%
surgehq.ai · 2026-09-24

Hard reasoning benchmarks

Rank among models with a published score, and the leaderboard around each model. ~ italic = no published score, estimated from related benchmarks.

Metric
GLM-5.3
Grok 4.7
Muse Spark 1.3
GPQA Diamond
day 0
#18/17291.7%Verified
  1. #1GPT-6 Astra96.1%
  2. #16Qwen3.8 Flash-Next92.3%
  3. #18GLM-5.391.7%
  4. #19GPT-5.3 Codex91.5%
artificialanalysis.ai · 2026-09-24
~#16/173~92.3%Estimated
  1. #1GPT-6 Astra96.1%
  2. #15GPT-5.6 Terra92.5%
  3. ~#16Grok 4.7Estimated92.3%
  4. #16Hy4 preview92.3%
estimated from related benchmarks
#5/17293.5%BestVerified
  1. #1GPT-6 Astra96.1%
  2. #5Kimi K393.5%
  3. #5Muse Spark 1.393.5%
  4. #5Qwen3.8 2.4T A95B93.5%
artificialanalysis.ai · 2026-09-24
Humanity's Last Exam
day 0
#21/17842.3%Verified
  1. #1Claude Opus 5.561.4%
  2. #20Qwen3.8 2.4T A95B42.4%
  3. #21GLM-5.342.3%
  4. #22Claude Sonnet 541.3%
artificialanalysis.ai · 2026-09-24
#16/17843.1%Verified
  1. #1Claude Opus 5.561.4%
  2. #15Hy4 preview43.4%
  3. #16Grok 4.743.1%
  4. #16Qwen3.8 Max (0902)43.1%
artificialanalysis.ai · 2026-09-24
#7/17848.7%BestVerified
  1. #1Claude Opus 5.561.4%
  2. #6MiMo-V2.6-Pro49.4%
  3. #7Muse Spark 1.348.7%
  4. #8GPT-6 Sol47.9%
artificialanalysis.ai · 2026-09-24
AIME (latest)
day 0
~#2/25~96.7%Estimated
  1. #1Inkling97.1%
  2. ~#2GLM-5.3Estimated96.7%
  3. #2Muse Glimmer94.7%
estimated from related benchmarks
~#2/25~96.5%Estimated
  1. #1Inkling97.1%
  2. ~#2Grok 4.7Estimated96.5%
  3. #2Muse Glimmer94.7%
estimated from related benchmarks
~#2/25~96.8%Estimated
  1. #1Inkling97.1%
  2. ~#2Muse Spark 1.3Estimated96.8%
  3. #2Muse Glimmer94.7%
estimated from related benchmarks
AA Intelligence Index
third-party
#11/7444.8Verified
  1. #1Claude Opus 5.557.6
  2. #10Qwen3.8 Max (0902)45.4
  3. #11GLM-5.344.8
  4. #12Grok 4.644.2
artificialanalysis.ai · 2026-09-24
#8/7446.4Verified
  1. #1Claude Opus 5.557.6
  2. #7GPT-6 Sol47.5
  3. #8Grok 4.746.4
  4. #9MiMo-V2.6-Pro46.3
artificialanalysis.ai · 2026-09-24
#6/7448.1BestVerified
  1. #1Claude Opus 5.557.6
  2. #5Claude Opus 550.8
  3. #6Muse Spark 1.348.1
  4. #7GPT-6 Sol47.5
artificialanalysis.ai · 2026-09-24

Agents benchmarks

Rank among models with a published score, and the leaderboard around each model. ~ italic = no published score, estimated from related benchmarks.

Metric
GLM-5.3
Grok 4.7
Muse Spark 1.3
τ²-bench (Telecom)
day 0
~#2/116~98.3%Estimated
  1. #1Step 3.7 Flash98.5%
  2. ~#2GLM-5.3Estimated98.3%
  3. #2Gemini 3.1 Pro95.6%
estimated from related benchmarks
~#2/116~96.4%Estimated
  1. #1Step 3.7 Flash98.5%
  2. ~#2Grok 4.7Estimated96.4%
  3. #2Gemini 3.1 Pro95.6%
estimated from related benchmarks
~#2/116~98.3%Estimated
  1. #1Step 3.7 Flash98.5%
  2. ~#2Muse Spark 1.3Estimated98.3%
  3. #2Gemini 3.1 Pro95.6%
estimated from related benchmarks
OSWorld-Verified
day 0
~#3/12~84.0%Estimated
  1. #1Kimi K384.8%
  2. #2Qwen3.8 27B84.3%
  3. ~#3GLM-5.3Estimated84.0%
  4. #3Nex-N2.5-Pro82.2%
estimated from related benchmarks
~#3/12~82.3%Estimated
  1. #1Kimi K384.8%
  2. #2Qwen3.8 27B84.3%
  3. ~#3Grok 4.7Estimated82.3%
  4. #3Nex-N2.5-Pro82.2%
estimated from related benchmarks
~#3/12~84.2%Estimated
  1. #1Kimi K384.8%
  2. #2Qwen3.8 27B84.3%
  3. ~#3Muse Spark 1.3Estimated84.2%
  4. #3Nex-N2.5-Pro82.2%
estimated from related benchmarks
OSWorld 2.0
day 0
~#2/5~58.4%Estimated
  1. #1GLM-5.3 Flash59.1%
  2. ~#2GLM-5.3Estimated58.4%
  3. #2Kimi K358.3%
estimated from related benchmarks
~#3/5~58.3%Estimated
  1. #1GLM-5.3 Flash59.1%
  2. #2Kimi K358.3%
  3. ~#3Grok 4.7Estimated58.3%
  4. #3GPT-5.6 Terra50.2%
estimated from related benchmarks
~#3/5~57.8%Estimated
  1. #1GLM-5.3 Flash59.1%
  2. #2Kimi K358.3%
  3. ~#3Muse Spark 1.3Estimated57.8%
  4. #3GPT-5.6 Terra50.2%
estimated from related benchmarks
BrowseComp
day 0
~#4/18~91.1%Estimated
  1. #1Atria Dawn Preview92.5%
  2. #3Kimi K391.2%
  3. ~#4GLM-5.3Estimated91.1%
  4. #4Claude Opus 590.8%
estimated from related benchmarks
~#7/18~88.6%Estimated
  1. #1Atria Dawn Preview92.5%
  2. #6Step 5 Preview88.7%
  3. ~#7Grok 4.7Estimated88.6%
  4. #7GPT-5.6 Terra87.5%
estimated from related benchmarks
~#3/18~91.4%Estimated
  1. #1Atria Dawn Preview92.5%
  2. #2GPT-6 Astra91.5%
  3. ~#3Muse Spark 1.3Estimated91.4%
  4. #3Kimi K391.2%
estimated from related benchmarks
GDPval-AA (Elo)
third-party
#8/861646Verified
  1. #1Claude Opus 5.51846
  2. #7Qwen3.8 Max (0902)1668
  3. #8GLM-5.31646
  4. #9GLM-5.3 Flash1641
artificialanalysis.ai · 2026-09-24
#4/861695BestVerified
  1. #1Claude Opus 5.51846
  2. #3Claude Opus 51708
  3. #4Grok 4.71695
  4. #5Muse Spark 1.31674
artificialanalysis.ai · 2026-09-24
#5/861674Verified
  1. #1Claude Opus 5.51846
  2. #4Grok 4.71695
  3. #5Muse Spark 1.31674
  4. #6MiMo-V2.6-Pro1673
artificialanalysis.ai · 2026-09-24
AutomationBench-AA
third-party
#6/7962.2%Verified
  1. #1Claude Opus 5.569.5%
  2. #5Grok 4.765.6%
  3. #6GLM-5.362.2%
  4. #7GPT-6 Sol61.6%
artificialanalysis.ai · 2026-09-24
#5/7965.6%BestVerified
  1. #1Claude Opus 5.569.5%
  2. #4Grok 4.667.0%
  3. #5Grok 4.765.6%
  4. #6GLM-5.362.2%
artificialanalysis.ai · 2026-09-24
#14/7957.9%Verified
  1. #1Claude Opus 5.569.5%
  2. #13Kimi K358.3%
  3. #14Muse Spark 1.357.9%
  4. #15Qwen3.8 2.4T A95B57.2%
artificialanalysis.ai · 2026-09-24
τ-Bench Banking (AA)
third-party
#2/8850.3%Verified
  1. #1Muse Spark 1.350.5%
  2. #2GLM-5.350.3%
  3. #3Qwen3.8 2.4T A95B49.1%
artificialanalysis.ai · 2026-09-24
~#11/89~43.4%Estimated
  1. #1Muse Spark 1.350.5%
  2. #10Gemini 3.8 Flash44.9%
  3. ~#11Grok 4.7Estimated43.4%
  4. #11Grok 4.643.3%
estimated from related benchmarks
#1/8850.5%BestVerified
  1. #1Muse Spark 1.350.5%
  2. #2GLM-5.350.3%
artificialanalysis.ai · 2026-09-24
Not comparable across labs (1)
OSWorld 2.0 (release not stated)
day 0
—
—
#1/466.9%Lab-reported
  1. #1Muse Spark 1.366.9%
  2. #2Nex-N2.5-Pro56.4%
dev.meta.ai · 2026-09-02