Skip to content
Model Pareto

Compare models

Side by side: quality per category, price, speed, and every benchmark cell with where it came from. Pick up to four.
Grok 4.6Kimi K3Qwen3.8 2.4T A95B
Focus

Coding: quality vs price

Compared models are ringed; the other 100 ranked here are greyed.

Lower price is better. Pareto frontier: Granite 4.2 3B, NVIDIA Nemotron 3 Nano 30B A3B, gpt-oss-20b, Ling-3.0-flash-VL, MiMo-V2.6-Flash, GLM-5.3 Flash, DeepSeek V4.1 Flash, MiMo-V2.6-Pro, Claude Sonnet 5.5, Claude Opus 5.5. 26 models are not plotted: Xing4.0-29B-A4B, Nex-N2.5-Pro, Atria Dawn Preview, Intern-S2-397B, Solar Open2 250B, Phi-4-reasoning-plus, Motif 3, Nex-N2-Pro, Nex-N2.5-Mini, A.X-K2, K2 Horizon 375B A23B, K-EXAONE 2.0 0803, K2 Horizon MoVA 36B A4B, Intern-S2-Preview (35B-A3B), Command A+, North Mini Code, G9v3-39A5B, Falcon-H1-34B-Instruct, Devstral 2, K2 Horizon 7B, Devstral Small 2, MiniCPM5-2B, Ling 3.0 Tiny, K2 Horizon 3.7B, K2 Horizon 0.9B, LFM2.5-2.6B.

26 models with no price data — shown in the strip at the left edge

Xing4.0-29B-A4B, Nex-N2.5-Pro, Atria Dawn Preview, Intern-S2-397B, Solar Open2 250B, Phi-4-reasoning-plus, Motif 3, Nex-N2-Pro, Nex-N2.5-Mini, A.X-K2, K2 Horizon 375B A23B, K-EXAONE 2.0 0803, K2 Horizon MoVA 36B A4B, Intern-S2-Preview (35B-A3B), Command A+, North Mini Code, G9v3-39A5B, Falcon-H1-34B-Instruct, Devstral 2, K2 Horizon 7B, Devstral Small 2, MiniCPM5-2B, Ling 3.0 Tiny, K2 Horizon 3.7B, K2 Horizon 0.9B, LFM2.5-2.6B

  • Best-value frontier (nothing is both cheaper and better)
  • Evidencestrong → weak
  • Estimated from other categories
  • Grok 4.6
    Quality
    59.0
    Rank
    #25/103
    Price
    $3.00/M tok
    Speed
    60tok/s
    In$2.00▾Out$6.00▾/M tok

    vs Kimi K3: −6.2 quality · 0.5× price

  • Kimi K3
    Quality
    65.2
    Rank
    #16/103
    Price
    $6.00/M tok
    Speed
    37tok/s
    In$3.00Out$15/M tok

    vs Grok 4.6: +6.2 quality · 2× price

  • Qwen3.8 2.4T A95B
    Quality
    55.6
    Rank
    #28/103
    Price
    $3.00/M tok
    Speed
    38tok/s
    In$2.00▾Out$6.00▾/M tok

    vs Kimi K3: −9.6 quality · 0.5× price

Overview

Metric
Grok 4.6
Kimi K3
Qwen3.8 2.4T A95B
Lab
SpaceXAI (xAI)
Moonshot AI (Kimi)
Alibaba Qwen
Released
Aug 12, 2026
Jul 16, 2026
Aug 12, 2026
Weights
Proprietary
Open
Open
Input price
$/M tok
$2.00Best
$3.00
$2.00Best
Output price
$/M tok
$6.00Best
$15
$6.00Best
Blended price
$/M tok · 3:1 in:out
$3.00Best
$6.00
$3.00Best
Output speed
tok/s
60Best
37
38
Context
tokens
500K
1MBest
262K

Quality by category

0–100 within each category (100 = best tracked model). Rank is among all models ranked there. Click a row to focus it.

Metric
Grok 4.6
Kimi K3
Qwen3.8 2.4T A95B
Coding
59.0±4.5
#25/103Verified
65.2±4.5Best
#16/103Verified
55.6±6.4
#28/103Mixed
Writing & chat
72.0±6.0
#22/146Verified
89.1±4.3Best
#5/146Verifiedbest value
73.2±7.3
#20/146Mixed
Vision
65.2±7.3
#21/82Verified
77.0±3.9Best
#11/82Mixed
Not ranked
Hard reasoning
82.2±3.7
#12/182Verified
83.4±3.7Best
#9/182Verified
78.8±3.7
#19/182Verified
Agents
84.1±5.8Best
#10/173Verified
82.4±3.5
#12/173Mixed
83.0±5.8
#11/173Verified

Coding benchmarks

Rank among models with a published score, and the leaderboard around each model. ~ italic = no published score, estimated from related benchmarks.

Metric
Grok 4.6
Kimi K3
Qwen3.8 2.4T A95B
SWE-bench Verified
day 0
~#3/14~82.8%Estimated
  1. #1Claude Opus 596.0%
  2. #2Claude Sonnet 585.2%
  3. ~#3Grok 4.6Estimated82.8%
  4. #3Gemini 3.1 Pro80.6%
estimated from related benchmarks
~#2/14~85.3%Estimated
  1. #1Claude Opus 596.0%
  2. ~#2Kimi K3Estimated85.3%
  3. #2Claude Sonnet 585.2%
estimated from related benchmarks
~#3/14~82.4%Estimated
  1. #1Claude Opus 596.0%
  2. #2Claude Sonnet 585.2%
  3. ~#3Qwen3.8 2.4T A95BEstimated82.4%
  4. #3Gemini 3.1 Pro80.6%
estimated from related benchmarks
SWE-bench Pro (Public)
day 0
~#7/19~64.1%Estimated
  1. #1Claude Opus 5.589.9%
  2. #6Hy4 preview65.7%
  3. ~#7Grok 4.6Estimated64.1%
  4. #7GPT-5.6 Terra63.4%
estimated from related benchmarks
~#6/19~66.6%Estimated
  1. #1Claude Opus 5.589.9%
  2. #5Intern-S2-397B68.5%
  3. ~#6Kimi K3Estimated66.6%
  4. #6Hy4 preview65.7%
estimated from related benchmarks
~#9/19~63.0%Estimated
  1. #1Claude Opus 5.589.9%
  2. #8Claude Sonnet 563.2%
  3. ~#9Qwen3.8 2.4T A95BEstimated63.0%
  4. #9Nex-N2.5-Pro61.2%
estimated from related benchmarks
DeepSWE v1.1
day 0
#15/3064.9%Verified
  1. #1DeepSeek V4.1 Flash74.2%
  2. #14Gemini 3.8 Flash65.8%
  3. #15Grok 4.664.9%
  4. #16Claude Fable 5.164.3%
artificialanalysis.ai · 2026-09-24
#8/3068.4%BestVerified
  1. #1DeepSeek V4.1 Flash74.2%
  2. #8Claude Opus 5.568.4%
  3. #8Kimi K368.4%
  4. #10MiMo-V2.6-Flash67.9%
artificialanalysis.ai · 2026-09-24
#25/3056.6%Lab-reported
  1. #1DeepSeek V4.1 Flash74.2%
  2. #24DeepSeek V4 Pro (0813)57.2%
  3. #25Qwen3.8 2.4T A95B56.6%
  4. #26Nex-N2.5-Pro55.8%
huggingface.co · 2026-08-12
Terminal-Bench 4.0
day 0
#19/8317.2%BestVerified
  1. #1Claude Sonnet 5.563.6%
  2. #18Gemini 3.8 Flash19.7%
  3. #19Grok 4.617.2%
  4. #20GPT-5.514.6%
artificialanalysis.ai · 2026-09-24
#23/8312.6%Verified
  1. #1Claude Sonnet 5.563.6%
  2. #23GPT-6 Luna12.6%
  3. #23Kimi K312.6%
  4. #26Qwen3.8 2.4T A95B11.1%
artificialanalysis.ai · 2026-09-24
#26/8311.1%Verified
  1. #1Claude Sonnet 5.563.6%
  2. #23Kimi K312.6%
  3. #26Qwen3.8 2.4T A95B11.1%
  4. #27Qwen3.8 27B5.6%
artificialanalysis.ai · 2026-09-24
LiveCodeBench
third-party
~#3/20~90.8%Estimated
  1. #1Qwen3.8-Omni-Flash92.6%
  2. #2Qwen3.8 Flash-Next91.9%
  3. ~#3Grok 4.6Estimated90.8%
  4. #3Qwen3.8 27B90.3%
estimated from related benchmarks
~#3/20~90.7%Estimated
  1. #1Qwen3.8-Omni-Flash92.6%
  2. #2Qwen3.8 Flash-Next91.9%
  3. ~#3Kimi K3Estimated90.7%
  4. #3Qwen3.8 27B90.3%
estimated from related benchmarks
~#4/20~89.4%Estimated
  1. #1Qwen3.8-Omni-Flash92.6%
  2. #3Qwen3.8 27B90.3%
  3. ~#4Qwen3.8 2.4T A95BEstimated89.4%
  4. #4Nemotron 3 Ultra89.0%
estimated from related benchmarks
SciCode
third-party
#20/9553.0%Verified
  1. #1Claude Opus 5.566.9%
  2. #19Qwen3.8 2.4T A95B54.1%
  3. #20Grok 4.653.0%
  4. #21GPT-5.5 Instant (June 2026)52.5%
artificialanalysis.ai · 2026-09-24
#5/9559.5%BestVerified
  1. #1Claude Opus 5.566.9%
  2. #4MiMo-V2.6-Pro60.9%
  3. #5Kimi K359.5%
  4. #6GLM-5.359.0%
artificialanalysis.ai · 2026-09-24
#19/9554.1%Verified
  1. #1Claude Opus 5.566.9%
  2. #18Claude Sonnet 554.3%
  3. #19Qwen3.8 2.4T A95B54.1%
  4. #20Grok 4.653.0%
artificialanalysis.ai · 2026-09-24
AA Coding Agent Index
third-party
#10/1447.0Verified
  1. #1Claude Opus 5.566.0
  2. #9Kimi K351.9
  3. #10Grok 4.647.0
  4. #11Qwen3.8 Max (0902)43.3
artificialanalysis.ai · 2026-09-24
#9/1451.9BestVerified
  1. #1Claude Opus 5.566.0
  2. #8GLM-5.353.6
  3. #9Kimi K351.9
  4. #10Grok 4.647.0
artificialanalysis.ai · 2026-09-24
~#11/15~46.8Estimated
  1. #1Claude Opus 5.566.0
  2. #10Grok 4.647.0
  3. ~#11Qwen3.8 2.4T A95BEstimated46.8
  4. #11Qwen3.8 Max (0902)43.3
estimated from related benchmarks
Not comparable across labs (1)
SWE-bench Pro (Qwen-corrected)
day 0
—
—
#1/467.7%Lab-reported
  1. #1Qwen3.8 2.4T A95B67.7%
  2. #2Qwen3.8-Omni-Flash63.3%
huggingface.co · 2026-08-12
Benchmarks in other categories (4)

Writing & chat benchmarks

Rank among models with a published score, and the leaderboard around each model. ~ italic = no published score, estimated from related benchmarks.

Metric
Grok 4.6
Kimi K3
Qwen3.8 2.4T A95B
IFBench
day 0
~#20/126~74.7%Estimated
  1. #1MiniMax-M382.9%
  2. #19GPT-5.3 Codex75.4%
  3. ~#20Grok 4.6Estimated74.7%
  4. #20Command A+73.9%
estimated from related benchmarks
~#3/126~82.6%Estimated
  1. #1MiniMax-M382.9%
  2. #2Qwen3.8 2.4T A95B82.8%
  3. ~#3Kimi K3Estimated82.6%
  4. #3Qwen3.8-Omni-Flash81.5%
estimated from related benchmarks
#2/12582.8%Lab-reported
  1. #1MiniMax-M382.9%
  2. #2Qwen3.8 2.4T A95B82.8%
  3. #3Qwen3.8-Omni-Flash81.5%
huggingface.co · 2026-08-12
MMMLU
day 0
~#2/5~89.6%Estimated
  1. #1Gemini 3.1 Pro92.6%
  2. ~#2Grok 4.6Estimated89.6%
  3. #2Gemma 4 31B88.4%
estimated from related benchmarks
~#2/5~92.0%Estimated
  1. #1Gemini 3.1 Pro92.6%
  2. ~#2Kimi K3Estimated92.0%
  3. #2Gemma 4 31B88.4%
estimated from related benchmarks
~#2/5~91.3%Estimated
  1. #1Gemini 3.1 Pro92.6%
  2. ~#2Qwen3.8 2.4T A95BEstimated91.3%
  3. #2Gemma 4 31B88.4%
estimated from related benchmarks
LMArena Text, Non-English (Elo)
third-party
#18/531447Verified
  1. #1Claude Opus 5.51501
  2. #18Claude Sonnet 51447
  3. #18Grok 4.61447
  4. #20Gemini 3.5 Flash-Lite1445
lmarena.ai · 2026-09-24
#7/531477BestVerified
  1. #1Claude Opus 5.51501
  2. #6Gemini 3.1 Pro1480
  3. #7Kimi K31477
  4. #8GPT-5.51474
lmarena.ai · 2026-09-25
~#16/54~1449Estimated
  1. #1Claude Opus 5.51501
  2. #15GPT-5.6 Terra1456
  3. ~#16Qwen3.8 2.4T A95BEstimated1449
  4. #16DeepSeek V4 Pro (0813)1448
estimated from related benchmarks
LMArena Text (Elo)
third-party
#22/531453Verified
  1. #1Claude Opus 5.51509
  2. #19Qwen3.7 Plus1456
  3. #22Grok 4.61453
  4. #23Gemma 4 31B1451
lmarena.ai · 2026-09-25
#6/531488BestVerified
  1. #1Claude Opus 5.51509
  2. #3Muse Spark 1.31493
  3. #6Kimi K31488
  4. #7Gemini 3.1 Pro1487
lmarena.ai · 2026-09-25
~#18/54~1460Estimated
  1. #1Claude Opus 5.51509
  2. #17Claude Sonnet 51461
  3. ~#18Qwen3.8 2.4T A95BEstimated1460
  4. #18GPT-6 Sol1457
estimated from related benchmarks
EQ-Bench Creative Writing v3 (Elo)
third-party
~#10/26~1897Estimated
  1. #1GPT-6 Astra2173
  2. #9Muse Spark 1.31906
  3. ~#10Grok 4.6Estimated1897
  4. #10GPT-5.6 Terra1855
estimated from related benchmarks
#5/252082BestVerified
  1. #1GPT-6 Astra2173
  2. #4GPT-6 Sol2125
  3. #5Kimi K32082
  4. #6GLM-5.32075
eqbench.com · 2026-09-24
#12/251843Verified
  1. #1GPT-6 Astra2173
  2. #11GPT-5.51844
  3. #12Qwen3.8 2.4T A95B1843
  4. #13Muse Glimmer1798
eqbench.com · 2026-09-24

Vision benchmarks

Rank among models with a published score, and the leaderboard around each model. ~ italic = no published score, estimated from related benchmarks.

Metric
Grok 4.6
Kimi K3
Qwen3.8 2.4T A95B
MMMU
day 0
~#2/3~71.3%Estimated
  1. #1Claude Haiku 4.573.2%
  2. ~#2Grok 4.6Estimated71.3%
  3. #2Llama 4 Maverick69.4%
estimated from related benchmarks
~#2/3~71.3%Estimated
  1. #1Claude Haiku 4.573.2%
  2. ~#2Kimi K3Estimated71.3%
  3. #2Llama 4 Maverick69.4%
estimated from related benchmarks
—
MMMU-Pro
day 0
~#10/77~81.5%Estimated
  1. #1Claude Opus 5.587.7%
  2. #9Intern-S2-397B81.7%
  3. ~#10Grok 4.6Estimated81.5%
  4. #10GPT-5.6 Terra80.7%
estimated from related benchmarks
#11/7680.5%Verified
  1. #1Claude Opus 5.587.7%
  2. #10GPT-5.6 Terra80.7%
  3. #11Kimi K380.5%
  4. #11Qwen3.7 Plus80.5%
artificialanalysis.ai · 2026-09-24
—
CharXiv Reasoning
day 0
~#5/9~81.8%Estimated
  1. #1Gemini 3.8 Flash86.2%
  2. #4Qwen3.8-Omni-Flash83.5%
  3. ~#5Grok 4.6Estimated81.8%
  4. #5Muse Glimmer78.8%
estimated from related benchmarks
#2/884.8%Lab-reported
  1. #1Gemini 3.8 Flash86.2%
  2. #2Kimi K384.8%
  3. #3Qwen3.8 Flash-Next84.6%
huggingface.co · 2026-07-16
—
OmniDocBench v1.5
third-party
~#4/8~88.2%Estimated
  1. #1MiniMax-M391.6%
  2. #2Qwen3.8 27B91.1%
  3. ~#4Grok 4.6Estimated88.2%
  4. #4Gemini 3.1 Pro85.3%
estimated from related benchmarks
#2/791.1%Lab-reported
  1. #1MiniMax-M391.6%
  2. #2Kimi K391.1%
  3. #2Qwen3.8 27B91.1%
huggingface.co · 2026-07-16
—
GDP.pdf (AA)
third-party
#16/4217.2%Verified
  1. #1GPT-6 Astra31.0%
  2. #15Gemini 3.1 Pro17.8%
  3. #16Grok 4.617.2%
  4. #17Qwen3.8 27B16.6%
artificialanalysis.ai · 2026-09-24
#8/4222.0%BestVerified
  1. #1GPT-6 Astra31.0%
  2. #7Qwen3.8 Max (0902)22.8%
  3. #8Kimi K322.0%
  4. #9Claude Opus 521.6%
artificialanalysis.ai · 2026-09-24
—
Chartography
third-party
#14/2220.5%Verified
  1. #1GPT-6 Astra71.0%
  2. #13Gemini 3.1 Pro26.1%
  3. #14Grok 4.620.5%
  4. #15Muse Glimmer17.2%
surgehq.ai · 2026-09-24
#12/2226.6%BestVerified
  1. #1GPT-6 Astra71.0%
  2. #11Claude Opus 527.3%
  3. #12Kimi K326.6%
  4. #13Gemini 3.1 Pro26.1%
surgehq.ai · 2026-09-24
—

Hard reasoning benchmarks

Rank among models with a published score, and the leaderboard around each model. ~ italic = no published score, estimated from related benchmarks.

Metric
Grok 4.6
Kimi K3
Qwen3.8 2.4T A95B
GPQA Diamond
day 0
#5/17293.5%BestVerified
  1. #1GPT-6 Astra96.1%
  2. #5GPT-5.593.5%
  3. #5Grok 4.693.5%
  4. #5Kimi K393.5%
artificialanalysis.ai · 2026-09-24
#5/17293.5%BestVerified
  1. #1GPT-6 Astra96.1%
  2. #5Grok 4.693.5%
  3. #5Kimi K393.5%
  4. #5Muse Spark 1.393.5%
artificialanalysis.ai · 2026-09-24
#5/17293.5%BestVerified
  1. #1GPT-6 Astra96.1%
  2. #5Muse Spark 1.393.5%
  3. #5Qwen3.8 2.4T A95B93.5%
  4. #5Step 5 Preview93.5%
artificialanalysis.ai · 2026-09-24
Humanity's Last Exam
day 0
#14/17844.1%Verified
  1. #1Claude Opus 5.561.4%
  2. #13GPT-5.545.8%
  3. #14Grok 4.644.1%
  4. #15Hy4 preview43.4%
artificialanalysis.ai · 2026-09-24
#11/17846.9%BestVerified
  1. #1Claude Opus 5.561.4%
  2. #10Gemini 3.1 Pro47.0%
  3. #11Kimi K346.9%
  4. #12Step 5 Preview46.5%
artificialanalysis.ai · 2026-09-24
#20/17842.4%Verified
  1. #1Claude Opus 5.561.4%
  2. #19GPT-5.3 Codex42.5%
  3. #20Qwen3.8 2.4T A95B42.4%
  4. #21GLM-5.342.3%
artificialanalysis.ai · 2026-09-24
AIME (latest)
day 0
~#2/25~96.8%Estimated
  1. #1Inkling97.1%
  2. ~#2Grok 4.6Estimated96.8%
  3. #2Muse Glimmer94.7%
estimated from related benchmarks
~#2/25~96.8%Estimated
  1. #1Inkling97.1%
  2. ~#2Kimi K3Estimated96.8%
  3. #2Muse Glimmer94.7%
estimated from related benchmarks
~#2/25~96.7%Estimated
  1. #1Inkling97.1%
  2. ~#2Qwen3.8 2.4T A95BEstimated96.7%
  3. #2Muse Glimmer94.7%
estimated from related benchmarks
AA Intelligence Index
third-party
#12/7444.2BestVerified
  1. #1Claude Opus 5.557.6
  2. #11GLM-5.344.8
  3. #12Grok 4.644.2
  4. #13Step 5 Preview43.7
artificialanalysis.ai · 2026-09-24
#14/7443.6Verified
  1. #1Claude Opus 5.557.6
  2. #13Step 5 Preview43.7
  3. #14Kimi K343.6
  4. #15GPT-5.6 Terra42.1
artificialanalysis.ai · 2026-09-24
#18/7439.9Verified
  1. #1Claude Opus 5.557.6
  2. #17Gemini 3.8 Flash40.9
  3. #18Qwen3.8 2.4T A95B39.9
  4. #19Qwen3.8 Flash-Next39.8
artificialanalysis.ai · 2026-09-24

Agents benchmarks

Rank among models with a published score, and the leaderboard around each model. ~ italic = no published score, estimated from related benchmarks.

Metric
Grok 4.6
Kimi K3
Qwen3.8 2.4T A95B
τ²-bench (Telecom)
day 0
~#2/116~97.7%Estimated
  1. #1Step 3.7 Flash98.5%
  2. ~#2Grok 4.6Estimated97.7%
  3. #2Gemini 3.1 Pro95.6%
estimated from related benchmarks
~#2/116~98.3%Estimated
  1. #1Step 3.7 Flash98.5%
  2. ~#2Kimi K3Estimated98.3%
  3. #2Gemini 3.1 Pro95.6%
estimated from related benchmarks
~#2/116~98.3%Estimated
  1. #1Step 3.7 Flash98.5%
  2. ~#2Qwen3.8 2.4T A95BEstimated98.3%
  3. #2Gemini 3.1 Pro95.6%
estimated from related benchmarks
OSWorld-Verified
day 0
~#3/12~82.4%Estimated
  1. #1Kimi K384.8%
  2. #2Qwen3.8 27B84.3%
  3. ~#3Grok 4.6Estimated82.4%
  4. #3Nex-N2.5-Pro82.2%
estimated from related benchmarks
#1/1184.8%Lab-reported
  1. #1Kimi K384.8%
  2. #2Qwen3.8 27B84.3%
huggingface.co · 2026-07-16
~#3/12~83.1%Estimated
  1. #1Kimi K384.8%
  2. #2Qwen3.8 27B84.3%
  3. ~#3Qwen3.8 2.4T A95BEstimated83.1%
  4. #3Nex-N2.5-Pro82.2%
estimated from related benchmarks
OSWorld 2.0
day 0
~#3/5~56.6%Estimated
  1. #1GLM-5.3 Flash59.1%
  2. #2Kimi K358.3%
  3. ~#3Grok 4.6Estimated56.6%
  4. #3GPT-5.6 Terra50.2%
estimated from related benchmarks
#2/458.3%Lab-reported
  1. #1GLM-5.3 Flash59.1%
  2. #2Kimi K358.3%
  3. #3GPT-5.6 Terra50.2%
huggingface.co · 2026-07-16
~#3/5~57.3%Estimated
  1. #1GLM-5.3 Flash59.1%
  2. #2Kimi K358.3%
  3. ~#3Qwen3.8 2.4T A95BEstimated57.3%
  4. #3GPT-5.6 Terra50.2%
estimated from related benchmarks
BrowseComp
day 0
~#6/18~89.6%Estimated
  1. #1Atria Dawn Preview92.5%
  2. #5Nex-N2.5-Pro89.7%
  3. ~#6Grok 4.6Estimated89.6%
  4. #6Step 5 Preview88.7%
estimated from related benchmarks
#3/1791.2%Lab-reported
  1. #1Atria Dawn Preview92.5%
  2. #2GPT-6 Astra91.5%
  3. #3Kimi K391.2%
  4. #4Claude Opus 590.8%
huggingface.co · 2026-07-16
~#5/18~89.9%Estimated
  1. #1Atria Dawn Preview92.5%
  2. #4Claude Opus 590.8%
  3. ~#5Qwen3.8 2.4T A95BEstimated89.9%
  4. #5Nex-N2.5-Pro89.7%
estimated from related benchmarks
GDPval-AA (Elo)
third-party
#10/861632BestVerified
  1. #1Claude Opus 5.51846
  2. #9GLM-5.3 Flash1641
  3. #10Grok 4.61632
  4. #11Qwen3.8 Flash-Next1612
artificialanalysis.ai · 2026-09-24
#16/861524Verified
  1. #1Claude Opus 5.51846
  2. #15GPT-6 Astra1542
  3. #16Kimi K31524
  4. #17GPT-6 Sol1487
artificialanalysis.ai · 2026-09-24
#13/861597Verified
  1. #1Claude Opus 5.51846
  2. #12DeepSeek V4.1 Flash1600
  3. #13Qwen3.8 2.4T A95B1597
  4. #14Step 5 Preview1566
artificialanalysis.ai · 2026-09-24
AutomationBench-AA
third-party
#4/7967.0%BestVerified
  1. #1Claude Opus 5.569.5%
  2. #3GPT-6 Astra68.5%
  3. #4Grok 4.667.0%
  4. #5Grok 4.765.6%
artificialanalysis.ai · 2026-09-24
#13/7958.3%Verified
  1. #1Claude Opus 5.569.5%
  2. #12MiMo-V2.6-Pro58.6%
  3. #13Kimi K358.3%
  4. #14Muse Spark 1.357.9%
artificialanalysis.ai · 2026-09-24
#15/7957.2%Verified
  1. #1Claude Opus 5.569.5%
  2. #14Muse Spark 1.357.9%
  3. #15Qwen3.8 2.4T A95B57.2%
  4. #16DeepSeek V4 Pro (0813)56.7%
artificialanalysis.ai · 2026-09-24
τ-Bench Banking (AA)
third-party
#11/8843.3%Verified
  1. #1Muse Spark 1.350.5%
  2. #10Gemini 3.8 Flash44.9%
  3. #11Grok 4.643.3%
  4. #12Claude Opus 542.1%
artificialanalysis.ai · 2026-09-24
#8/8846.0%Verified
  1. #1Muse Spark 1.350.5%
  2. #6GLM-5.3 Flash47.2%
  3. #8Kimi K346.0%
  4. #9Qwen3.8 Flash-Next45.4%
artificialanalysis.ai · 2026-09-24
#3/8849.1%BestVerified
  1. #1Muse Spark 1.350.5%
  2. #2GLM-5.350.3%
  3. #3Qwen3.8 2.4T A95B49.1%
  4. #4Qwen3.8 27B48.0%
artificialanalysis.ai · 2026-09-24