Skip to content
Model Pareto

Compare models

Side by side: quality per category, price, speed, and every benchmark cell with where it came from. Pick up to four.
Qwen3.8 Flash-NextDeepSeek V4.1 FlashGPT-6 Astra
Focus

Coding: quality vs price

Compared models are ringed; the other 100 ranked here are greyed.

Lower price is better. Pareto frontier: Granite 4.2 3B, NVIDIA Nemotron 3 Nano 30B A3B, gpt-oss-20b, Ling-3.0-flash-VL, MiMo-V2.6-Flash, GLM-5.3 Flash, DeepSeek V4.1 Flash, MiMo-V2.6-Pro, Claude Sonnet 5.5, Claude Opus 5.5. 26 models are not plotted: Xing4.0-29B-A4B, Nex-N2.5-Pro, Atria Dawn Preview, Intern-S2-397B, Solar Open2 250B, Phi-4-reasoning-plus, Motif 3, Nex-N2-Pro, Nex-N2.5-Mini, A.X-K2, K2 Horizon 375B A23B, K-EXAONE 2.0 0803, K2 Horizon MoVA 36B A4B, Intern-S2-Preview (35B-A3B), Command A+, North Mini Code, G9v3-39A5B, Falcon-H1-34B-Instruct, Devstral 2, K2 Horizon 7B, Devstral Small 2, MiniCPM5-2B, Ling 3.0 Tiny, K2 Horizon 3.7B, K2 Horizon 0.9B, LFM2.5-2.6B.

26 models with no price data — shown in the strip at the left edge

Xing4.0-29B-A4B, Nex-N2.5-Pro, Atria Dawn Preview, Intern-S2-397B, Solar Open2 250B, Phi-4-reasoning-plus, Motif 3, Nex-N2-Pro, Nex-N2.5-Mini, A.X-K2, K2 Horizon 375B A23B, K-EXAONE 2.0 0803, K2 Horizon MoVA 36B A4B, Intern-S2-Preview (35B-A3B), Command A+, North Mini Code, G9v3-39A5B, Falcon-H1-34B-Instruct, Devstral 2, K2 Horizon 7B, Devstral Small 2, MiniCPM5-2B, Ling 3.0 Tiny, K2 Horizon 3.7B, K2 Horizon 0.9B, LFM2.5-2.6B

  • Best-value frontier (nothing is both cheaper and better)
  • Evidencestrong → weak
  • Estimated from other categories
  • Qwen3.8 Flash-Next
    Quality
    62.0
    Rank
    #20/103
    Price
    $0.23/M tok
    Speed
    54tok/s
    In$0.15▾Out$0.47▾/M tok

    vs GPT-6 Astra: −24.3 quality · 0.01× price

  • DeepSeek V4.1 Flash
    Quality
    66.4
    Rank
    #14/103
    Price
    $0.52/M tok
    Speed
    232tok/s
    In$0.30Out$1.20/M tok

    vs GPT-6 Astra: −19.8 quality · 0.03× price

  • GPT-6 Astra
    Quality
    86.2
    Rank
    #4/103
    Price
    $20.0/M tok
    Speed
    52tok/s
    In$10Out$50/M tok

    vs DeepSeek V4.1 Flash: +19.8 quality · 38× price

Overview

Metric
Qwen3.8 Flash-Next
DeepSeek V4.1 Flash
GPT-6 Astra
Lab
Alibaba Qwen
DeepSeek
OpenAI
Released
Aug 26, 2026
Sep 10, 2026
Sep 3, 2026
Weights
Open
Open
Proprietary
Input price
$/M tok
$0.15Best
$0.30
$10
Output price
$/M tok
$0.47Best
$1.20
$50
Blended price
$/M tok · 3:1 in:out
$0.23Best
$0.525
$20
Output speed
tok/s
54
232Best
52
Context
tokens
262K
1MBest
1MBest

Quality by category

0–100 within each category (100 = best tracked model). Rank is among all models ranked there. Click a row to focus it.

Metric
Qwen3.8 Flash-Next
DeepSeek V4.1 Flash
GPT-6 Astra
Coding
62.0±5.2
#20/103Mixed
66.4±6.4
#14/103Mixedbest value
86.2±4.5Best
#4/103Verified
Writing & chat
80.0±9.7
#12/146Lab-reportedbest value
69.8±4.3
#26/146Verified
92.1±5.3Best
#4/146Verified
Vision
72.6±5.3
#16/82Mixed
56.4±4.8
#35/82Verified
98.9±3.0Best
#1/82Verifiedbest value
Hard reasoning
76.0±3.7
#24/182Verifiedbest value
76.1±4.0
#23/182Mixed
93.5±3.7Best
#4/182Verified
Agents
81.7±5.8
#14/173Verifiedbest value
82.1±7.8Best
#13/173Verified
81.6±4.6
#15/173Mixed

Coding benchmarks

Rank among models with a published score, and the leaderboard around each model. ~ italic = no published score, estimated from related benchmarks.

Metric
Qwen3.8 Flash-Next
DeepSeek V4.1 Flash
GPT-6 Astra
SWE-bench Verified
day 0
~#3/14~82.9%Estimated
  1. #1Claude Opus 596.0%
  2. #2Claude Sonnet 585.2%
  3. ~#3Qwen3.8 Flash-NextEstimated82.9%
  4. #3Gemini 3.1 Pro80.6%
estimated from related benchmarks
~#3/14~83.2%Estimated
  1. #1Claude Opus 596.0%
  2. #2Claude Sonnet 585.2%
  3. ~#3DeepSeek V4.1 FlashEstimated83.2%
  4. #3Gemini 3.1 Pro80.6%
estimated from related benchmarks
~#2/14~90.0%Estimated
  1. #1Claude Opus 596.0%
  2. ~#2GPT-6 AstraEstimated90.0%
  3. #2Claude Sonnet 585.2%
estimated from related benchmarks
SWE-bench Pro (Public)
day 0
~#7/19~64.7%Estimated
  1. #1Claude Opus 5.589.9%
  2. #6Hy4 preview65.7%
  3. ~#7Qwen3.8 Flash-NextEstimated64.7%
  4. #7GPT-5.6 Terra63.4%
estimated from related benchmarks
~#6/19~65.9%Estimated
  1. #1Claude Opus 5.589.9%
  2. #5Intern-S2-397B68.5%
  3. ~#6DeepSeek V4.1 FlashEstimated65.9%
  4. #6Hy4 preview65.7%
estimated from related benchmarks
~#5/19~75.1%Estimated
  1. #1Claude Opus 5.589.9%
  2. #4Claude Opus 579.2%
  3. ~#5GPT-6 AstraEstimated75.1%
  4. #5Intern-S2-397B68.5%
estimated from related benchmarks
DeepSWE v1.1
day 0
#22/3058.7%Lab-reported
  1. #1DeepSeek V4.1 Flash74.2%
  2. #21GLM-5.361.4%
  3. #22Qwen3.8 Flash-Next58.7%
  4. #23Qwen3.8-Omni-Flash57.8%
huggingface.co · 2026-08-26
#1/3074.2%BestLab-reported
  1. #1DeepSeek V4.1 Flash74.2%
  2. #2Grok 4.772.6%
huggingface.co · 2026-09-10
#12/3067.6%Verified
  1. #1DeepSeek V4.1 Flash74.2%
  2. #11Step 5 Preview67.7%
  3. #12GPT-6 Astra67.6%
  4. #13GPT-5.567.0%
artificialanalysis.ai · 2026-09-24
Terminal-Bench 4.0
day 0
#16/8325.3%Verified
  1. #1Claude Sonnet 5.563.6%
  2. #15Grok 4.725.8%
  3. #16Qwen3.8 Flash-Next25.3%
  4. #17MiMo-V2.6-Flash22.7%
artificialanalysis.ai · 2026-09-24
#14/8326.8%Verified
  1. #1Claude Sonnet 5.563.6%
  2. #13GLM-5.3 Flash32.8%
  3. #14DeepSeek V4.1 Flash26.8%
  4. #15Grok 4.725.8%
artificialanalysis.ai · 2026-09-24
#3/8359.1%BestVerified
  1. #1Claude Sonnet 5.563.6%
  2. #2Claude Opus 5.559.6%
  3. #3GPT-6 Astra59.1%
  4. #4Claude Fable 5.152.0%
artificialanalysis.ai · 2026-09-24
LiveCodeBench
third-party
#2/1991.9%Lab-reported
  1. #1Qwen3.8-Omni-Flash92.6%
  2. #2Qwen3.8 Flash-Next91.9%
  3. #3Qwen3.8 27B90.3%
huggingface.co · 2026-08-26
~#5/20~88.7%Estimated
  1. #1Qwen3.8-Omni-Flash92.6%
  2. #4Nemotron 3 Ultra89.0%
  3. ~#5DeepSeek V4.1 FlashEstimated88.7%
  4. #5gpt-oss-120b87.8%
estimated from related benchmarks
~#2/20~92.3%Estimated
  1. #1Qwen3.8-Omni-Flash92.6%
  2. ~#2GPT-6 AstraEstimated92.3%
  3. #2Qwen3.8 Flash-Next91.9%
estimated from related benchmarks
SciCode
third-party
#28/9550.6%Verified
  1. #1Claude Opus 5.566.9%
  2. #27DeepSeek V4 Pro (0813)51.0%
  3. #28Qwen3.8 Flash-Next50.6%
  4. #29Inkling Small49.7%
artificialanalysis.ai · 2026-09-24
#24/9551.9%Verified
  1. #1Claude Opus 5.566.9%
  2. #22Qwen3.8 Max (0902)52.1%
  3. #24DeepSeek V4.1 Flash51.9%
  4. #25GLM-5.3 Flash51.6%
artificialanalysis.ai · 2026-09-24
#13/9556.5%BestVerified
  1. #1Claude Opus 5.566.9%
  2. #12Gemini 3.8 Flash56.6%
  3. #13GPT-6 Astra56.5%
  4. #14Claude Opus 556.4%
artificialanalysis.ai · 2026-09-24
AA Coding Agent Index
third-party
~#10/15~47.7Estimated
  1. #1Claude Opus 5.566.0
  2. #9Kimi K351.9
  3. ~#10Qwen3.8 Flash-NextEstimated47.7
  4. #10Grok 4.647.0
estimated from related benchmarks
~#10/15~48.0Estimated
  1. #1Claude Opus 5.566.0
  2. #9Kimi K351.9
  3. ~#10DeepSeek V4.1 FlashEstimated48.0
  4. #10Grok 4.647.0
estimated from related benchmarks
#3/1461.6Verified
  1. #1Claude Opus 5.566.0
  2. #2Claude Fable 5.162.2
  3. #3GPT-6 Astra61.6
  4. #4Claude Opus 559.7
artificialanalysis.ai · 2026-09-24
Not comparable across labs (1)
SWE-bench Pro (Qwen-corrected)
day 0
#3/462.5%Lab-reported
  1. #1Qwen3.8 2.4T A95B67.7%
  2. #2Qwen3.8-Omni-Flash63.3%
  3. #3Qwen3.8 Flash-Next62.5%
  4. #4Qwen3.8 27B61.7%
huggingface.co · 2026-08-26
—
—
Benchmarks in other categories (4)

Writing & chat benchmarks

Rank among models with a published score, and the leaderboard around each model. ~ italic = no published score, estimated from related benchmarks.

Metric
Qwen3.8 Flash-Next
DeepSeek V4.1 Flash
GPT-6 Astra
IFBench
day 0
#5/12581.3%Lab-reported
  1. #1MiniMax-M382.9%
  2. #4Nemotron 3 Ultra81.4%
  3. #5Qwen3.8 Flash-Next81.3%
  4. #6Intern-S2-Preview (35B-A3B)80.9%
huggingface.co · 2026-08-26
~#19/126~75.5%Estimated
  1. #1MiniMax-M382.9%
  2. #18Gemma 4 31B75.6%
  3. ~#19DeepSeek V4.1 FlashEstimated75.5%
  4. #19GPT-5.3 Codex75.4%
estimated from related benchmarks
~#3/126~81.9%Estimated
  1. #1MiniMax-M382.9%
  2. #2Qwen3.8 2.4T A95B82.8%
  3. ~#3GPT-6 AstraEstimated81.9%
  4. #3Qwen3.8-Omni-Flash81.5%
estimated from related benchmarks
MMMLU
day 0
~#2/5~91.5%Estimated
  1. #1Gemini 3.1 Pro92.6%
  2. ~#2Qwen3.8 Flash-NextEstimated91.5%
  3. #2Gemma 4 31B88.4%
estimated from related benchmarks
~#2/5~90.8%Estimated
  1. #1Gemini 3.1 Pro92.6%
  2. ~#2DeepSeek V4.1 FlashEstimated90.8%
  3. #2Gemma 4 31B88.4%
estimated from related benchmarks
~#2/5~91.4%Estimated
  1. #1Gemini 3.1 Pro92.6%
  2. ~#2GPT-6 AstraEstimated91.4%
  3. #2Gemma 4 31B88.4%
estimated from related benchmarks
LMArena Text, Non-English (Elo)
third-party
~#15/54~1457Estimated
  1. #1Claude Opus 5.51501
  2. #14GPT-6 AstraFew votes1460
  3. ~#15Qwen3.8 Flash-NextEstimated1457
  4. #15GPT-5.6 Terra1456
estimated from related benchmarks
#12/531462BestVerified
  1. #1Claude Opus 5.51501
  2. #11GLM-5.3 Flash1463
  3. #12DeepSeek V4.1 Flash1462
  4. #13MiMo-V2.6-Pro1461
lmarena.ai · 2026-09-25
#14/531460VerifiedFew votes
  1. #1Claude Opus 5.51501
  2. #13MiMo-V2.6-Pro1461
  3. #14GPT-6 AstraFew votes1460
  4. #15GPT-5.6 Terra1456
lmarena.ai · 2026-09-24
LMArena Text (Elo)
third-party
~#15/54~1468Estimated
  1. #1Claude Opus 5.51509
  2. #14GLM-5.3 Flash1475
  3. ~#15Qwen3.8 Flash-NextEstimated1468
  4. #15GPT-5.6 Terra1466
estimated from related benchmarks
#13/531477Verified
  1. #1Claude Opus 5.51509
  2. #10MiMo-V2.6-Pro1480
  3. #13DeepSeek V4.1 Flash1477
  4. #14GLM-5.3 Flash1475
lmarena.ai · 2026-09-25
#10/531480BestVerifiedFew votes
  1. #1Claude Opus 5.51509
  2. #10GLM-5.31480
  3. #10GPT-6 AstraFew votes1480
  4. #10MiMo-V2.6-Pro1480
lmarena.ai · 2026-09-24
EQ-Bench Creative Writing v3 (Elo)
third-party
~#9/26~1947Estimated
  1. #1GPT-6 Astra2173
  2. #8Grok 4.72007
  3. ~#9Qwen3.8 Flash-NextEstimated1947
  4. #9Muse Spark 1.31906
estimated from related benchmarks
#20/251540Verified
  1. #1GPT-6 Astra2173
  2. #19Gemini 3.5 Flash-Lite1559
  3. #20DeepSeek V4.1 Flash1540
  4. #21Gemini 3.1 Pro1491
eqbench.com · 2026-09-24
#1/252173BestVerified
  1. #1GPT-6 Astra2173
  2. #2Claude Fable 5.12162
eqbench.com · 2026-09-24

Vision benchmarks

Rank among models with a published score, and the leaderboard around each model. ~ italic = no published score, estimated from related benchmarks.

Metric
Qwen3.8 Flash-Next
DeepSeek V4.1 Flash
GPT-6 Astra
MMMU
day 0
~#2/3~71.3%Estimated
  1. #1Claude Haiku 4.573.2%
  2. ~#2Qwen3.8 Flash-NextEstimated71.3%
  3. #2Llama 4 Maverick69.4%
estimated from related benchmarks
~#2/3~71.3%Estimated
  1. #1Claude Haiku 4.573.2%
  2. ~#2DeepSeek V4.1 FlashEstimated71.3%
  3. #2Llama 4 Maverick69.4%
estimated from related benchmarks
~#2/3~71.3%Estimated
  1. #1Claude Haiku 4.573.2%
  2. ~#2GPT-6 AstraEstimated71.3%
  3. #2Llama 4 Maverick69.4%
estimated from related benchmarks
MMMU-Pro
day 0
#14/7679.8%Verified
  1. #1Claude Opus 5.587.7%
  2. #13GPT-5.579.9%
  3. #14Qwen3.8 Flash-Next79.8%
  4. #15Apodex 1.179.2%
artificialanalysis.ai · 2026-09-24
#22/7677.0%Verified
  1. #1Claude Opus 5.587.7%
  2. #20Qwen3.5 397B A17B77.3%
  3. #22DeepSeek V4.1 Flash77.0%
  4. #23Intern-S2-Preview (35B-A3B)76.9%
artificialanalysis.ai · 2026-09-24
#2/7686.9%BestVerified
  1. #1Claude Opus 5.587.7%
  2. #2GPT-6 Astra86.9%
  3. #3Gemini 3.8 Flash85.6%
artificialanalysis.ai · 2026-09-24
CharXiv Reasoning
day 0
#3/884.6%Lab-reported
  1. #1Gemini 3.8 Flash86.2%
  2. #2Kimi K384.8%
  3. #3Qwen3.8 Flash-Next84.6%
  4. #4Qwen3.8-Omni-Flash83.5%
huggingface.co · 2026-08-26
~#5/9~79.2%Estimated
  1. #1Gemini 3.8 Flash86.2%
  2. #4Qwen3.8-Omni-Flash83.5%
  3. ~#5DeepSeek V4.1 FlashEstimated79.2%
  4. #5Muse Glimmer78.8%
estimated from related benchmarks
~#2/9~86.1%Estimated
  1. #1Gemini 3.8 Flash86.2%
  2. ~#2GPT-6 AstraEstimated86.1%
  3. #2Kimi K384.8%
estimated from related benchmarks
OmniDocBench v1.5
third-party
~#4/8~88.9%Estimated
  1. #1MiniMax-M391.6%
  2. #2Qwen3.8 27B91.1%
  3. ~#4Qwen3.8 Flash-NextEstimated88.9%
  4. #4Gemini 3.1 Pro85.3%
estimated from related benchmarks
~#5/8~85.2%Estimated
  1. #1MiniMax-M391.6%
  2. #4Gemini 3.1 Pro85.3%
  3. ~#5DeepSeek V4.1 FlashEstimated85.2%
  4. #5Claude Haiku 4.579.6%
estimated from related benchmarks
~#2/8~91.4%Estimated
  1. #1MiniMax-M391.6%
  2. ~#2GPT-6 AstraEstimated91.4%
  3. #2Kimi K391.1%
estimated from related benchmarks
GDP.pdf (AA)
third-party
#18/4215.6%Verified
  1. #1GPT-6 Astra31.0%
  2. #17Qwen3.8 27B16.6%
  3. #18Qwen3.8 Flash-Next15.6%
  4. #19GLM-5.3 Flash15.4%
artificialanalysis.ai · 2026-09-24
#24/4212.8%Verified
  1. #1GPT-6 Astra31.0%
  2. #23Claude Sonnet 513.2%
  3. #24DeepSeek V4.1 Flash12.8%
  4. #24Inkling12.8%
artificialanalysis.ai · 2026-09-24
#1/4231.0%BestVerified
  1. #1GPT-6 Astra31.0%
  2. #2Muse Spark 1.326.6%
artificialanalysis.ai · 2026-09-24
Chartography
third-party
~#10/23~27.9%Estimated
  1. #1GPT-6 Astra71.0%
  2. #8Qwen3.8 Max (0902)29.1%
  3. ~#10Qwen3.8 Flash-NextEstimated27.9%
  4. #10Muse Spark 1.327.6%
estimated from related benchmarks
#19/2211.6%Verified
  1. #1GPT-6 Astra71.0%
  2. #18Grok 4.714.7%
  3. #19DeepSeek V4.1 Flash11.6%
  4. #20Gemini 3.5 Flash-Lite10.2%
surgehq.ai · 2026-09-24
#1/2271.0%BestVerified
  1. #1GPT-6 Astra71.0%
  2. #2Claude Opus 5.566.3%
surgehq.ai · 2026-09-24

Hard reasoning benchmarks

Rank among models with a published score, and the leaderboard around each model. ~ italic = no published score, estimated from related benchmarks.

Metric
Qwen3.8 Flash-Next
DeepSeek V4.1 Flash
GPT-6 Astra
GPQA Diamond
day 0
#16/17292.3%Verified
  1. #1GPT-6 Astra96.1%
  2. #16Hy4 preview92.3%
  3. #16Qwen3.8 Flash-Next92.3%
  4. #18GLM-5.391.7%
artificialanalysis.ai · 2026-09-24
#23/17290.9%Lab-reported
  1. #1GPT-6 Astra96.1%
  2. #22Qwen3.8-Omni-Flash91.0%
  3. #23DeepSeek V4.1 Flash90.9%
  4. #24Qwen3.8 27B90.5%
huggingface.co · 2026-09-10
#1/17296.1%BestVerified
  1. #1GPT-6 Astra96.1%
  2. #2Gemini 3.8 Flash95.3%
artificialanalysis.ai · 2026-09-24
Humanity's Last Exam
day 0
#29/17838.0%Verified
  1. #1Claude Opus 5.561.4%
  2. #28Grok Build 0.1 061638.3%
  3. #29Qwen3.8 Flash-Next38.0%
  4. #30Motif 337.0%
artificialanalysis.ai · 2026-09-24
#25/17839.2%Verified
  1. #1Claude Opus 5.561.4%
  2. #24GLM-5.3 Flash39.9%
  3. #25DeepSeek V4.1 Flash39.2%
  4. #26MiniMax-M339.0%
artificialanalysis.ai · 2026-09-24
#5/17854.7%BestVerified
  1. #1Claude Opus 5.561.4%
  2. #4Claude Opus 554.9%
  3. #5GPT-6 Astra54.7%
  4. #6MiMo-V2.6-Pro49.4%
artificialanalysis.ai · 2026-09-24
AIME (latest)
day 0
~#2/25~96.7%Estimated
  1. #1Inkling97.1%
  2. ~#2Qwen3.8 Flash-NextEstimated96.7%
  3. #2Muse Glimmer94.7%
estimated from related benchmarks
~#2/25~96.7%Estimated
  1. #1Inkling97.1%
  2. ~#2DeepSeek V4.1 FlashEstimated96.7%
  3. #2Muse Glimmer94.7%
estimated from related benchmarks
~#2/25~96.9%Estimated
  1. #1Inkling97.1%
  2. ~#2GPT-6 AstraEstimated96.9%
  3. #2Muse Glimmer94.7%
estimated from related benchmarks
AA Intelligence Index
third-party
#19/7439.8Verified
  1. #1Claude Opus 5.557.6
  2. #18Qwen3.8 2.4T A95B39.9
  3. #19Qwen3.8 Flash-Next39.8
  4. #20DeepSeek V4.1 Flash39.5
artificialanalysis.ai · 2026-09-24
#20/7439.5Verified
  1. #1Claude Opus 5.557.6
  2. #19Qwen3.8 Flash-Next39.8
  3. #20DeepSeek V4.1 Flash39.5
  4. #21GPT-5.538.4
artificialanalysis.ai · 2026-09-24
#4/7452.7BestVerified
  1. #1Claude Opus 5.557.6
  2. #3Claude Fable 5.153.4
  3. #4GPT-6 Astra52.7
  4. #5Claude Opus 550.8
artificialanalysis.ai · 2026-09-24

Agents benchmarks

Rank among models with a published score, and the leaderboard around each model. ~ italic = no published score, estimated from related benchmarks.

Metric
Qwen3.8 Flash-Next
DeepSeek V4.1 Flash
GPT-6 Astra
τ²-bench (Telecom)
day 0
~#2/116~98.3%Estimated
  1. #1Step 3.7 Flash98.5%
  2. ~#2Qwen3.8 Flash-NextEstimated98.3%
  3. #2Gemini 3.1 Pro95.6%
estimated from related benchmarks
~#4/116~95.5%Estimated
  1. #1Step 3.7 Flash98.5%
  2. #2Qwen3.5 397B A17B95.6%
  3. ~#4DeepSeek V4.1 FlashEstimated95.5%
  4. #4Qwen3.6 35B A3B95.3%
estimated from related benchmarks
~#2/116~98.3%Estimated
  1. #1Step 3.7 Flash98.5%
  2. ~#2GPT-6 AstraEstimated98.3%
  3. #2Gemini 3.1 Pro95.6%
estimated from related benchmarks
OSWorld-Verified
day 0
~#3/12~83.6%Estimated
  1. #1Kimi K384.8%
  2. #2Qwen3.8 27B84.3%
  3. ~#3Qwen3.8 Flash-NextEstimated83.6%
  4. #3Nex-N2.5-Pro82.2%
estimated from related benchmarks
~#5/12~81.7%Estimated
  1. #1Kimi K384.8%
  2. #4MiMo-V2.6-Pro82.0%
  3. ~#5DeepSeek V4.1 FlashEstimated81.7%
  4. #5Claude Sonnet 581.2%
estimated from related benchmarks
~#3/12~83.4%Estimated
  1. #1Kimi K384.8%
  2. #2Qwen3.8 27B84.3%
  3. ~#3GPT-6 AstraEstimated83.4%
  4. #3Nex-N2.5-Pro82.2%
estimated from related benchmarks
OSWorld 2.0
day 0
~#3/5~56.6%Estimated
  1. #1GLM-5.3 Flash59.1%
  2. #2Kimi K358.3%
  3. ~#3Qwen3.8 Flash-NextEstimated56.6%
  4. #3GPT-5.6 Terra50.2%
estimated from related benchmarks
~#3/5~57.7%Estimated
  1. #1GLM-5.3 Flash59.1%
  2. #2Kimi K358.3%
  3. ~#3DeepSeek V4.1 FlashEstimated57.7%
  4. #3GPT-5.6 Terra50.2%
estimated from related benchmarks
~#3/5~55.0%Estimated
  1. #1GLM-5.3 Flash59.1%
  2. #2Kimi K358.3%
  3. ~#3GPT-6 AstraEstimated55.0%
  4. #3GPT-5.6 Terra50.2%
estimated from related benchmarks
BrowseComp
day 0
~#5/18~90.4%Estimated
  1. #1Atria Dawn Preview92.5%
  2. #4Claude Opus 590.8%
  3. ~#5Qwen3.8 Flash-NextEstimated90.4%
  4. #5Nex-N2.5-Pro89.7%
estimated from related benchmarks
~#7/18~87.6%Estimated
  1. #1Atria Dawn Preview92.5%
  2. #6Step 5 Preview88.7%
  3. ~#7DeepSeek V4.1 FlashEstimated87.6%
  4. #7GPT-5.6 Terra87.5%
estimated from related benchmarks
#2/1791.5%Lab-reported
  1. #1Atria Dawn Preview92.5%
  2. #2GPT-6 Astra91.5%
  3. #3Kimi K391.2%
openai.com · 2026-09-03
GDPval-AA (Elo)
third-party
#11/861612BestVerified
  1. #1Claude Opus 5.51846
  2. #10Grok 4.61632
  3. #11Qwen3.8 Flash-Next1612
  4. #12DeepSeek V4.1 Flash1600
artificialanalysis.ai · 2026-09-24
#12/861600Verified
  1. #1Claude Opus 5.51846
  2. #11Qwen3.8 Flash-Next1612
  3. #12DeepSeek V4.1 Flash1600
  4. #13Qwen3.8 2.4T A95B1597
artificialanalysis.ai · 2026-09-24
#15/861542Verified
  1. #1Claude Opus 5.51846
  2. #14Step 5 Preview1566
  3. #15GPT-6 Astra1542
  4. #16Kimi K31524
artificialanalysis.ai · 2026-09-24
AutomationBench-AA
third-party
#19/7955.9%Verified
  1. #1Claude Opus 5.569.5%
  2. #18Qwen3.8 Max (0902)56.2%
  3. #19Qwen3.8 Flash-Next55.9%
  4. #20GPT-6 Luna53.2%
artificialanalysis.ai · 2026-09-24
#2/7968.9%BestVerified
  1. #1Claude Opus 5.569.5%
  2. #2DeepSeek V4.1 Flash68.9%
  3. #3GPT-6 Astra68.5%
artificialanalysis.ai · 2026-09-24
#3/7968.5%Verified
  1. #1Claude Opus 5.569.5%
  2. #2DeepSeek V4.1 Flash68.9%
  3. #3GPT-6 Astra68.5%
  4. #4Grok 4.667.0%
artificialanalysis.ai · 2026-09-24
τ-Bench Banking (AA)
third-party
#9/8845.4%BestVerified
  1. #1Muse Spark 1.350.5%
  2. #8Kimi K346.0%
  3. #9Qwen3.8 Flash-Next45.4%
  4. #10Gemini 3.8 Flash44.9%
artificialanalysis.ai · 2026-09-24
~#14/89~40.7%Estimated
  1. #1Muse Spark 1.350.5%
  2. #13GPT-6 Astra41.4%
  3. ~#14DeepSeek V4.1 FlashEstimated40.7%
  4. #14GPT-5.6 Terra40.2%
estimated from related benchmarks
#13/8841.4%Verified
  1. #1Muse Spark 1.350.5%
  2. #12Claude Opus 542.1%
  3. #13GPT-6 Astra41.4%
  4. #14GPT-5.6 Terra40.2%
artificialanalysis.ai · 2026-09-24
Not comparable across labs (2)
OSWorld 2.0 (offline set v2026.08.08)
day 0
—
—
#1/372.6%Lab-reported
  1. #1GPT-6 Astra72.6%
  2. #2GPT-6 Sol64.4%
openai.com · 2026-09-03
OSWorld 2.0 (release not stated)
day 0
#3/452.3%Lab-reported
  1. #1Muse Spark 1.366.9%
  2. #2Nex-N2.5-Pro56.4%
  3. #3Qwen3.8 Flash-Next52.3%
  4. #4Nex-N2.5-Mini30.5%
huggingface.co · 2026-08-26
—
—