Skip to content
Model Pareto

Compare models

Side by side: quality per category, price, speed, and every benchmark cell with where it came from. Pick up to four.
BorealGPT-6 AstraClaude Opus 5.5GPT-6.1 SolUp to 4 models — remove one to add another.

Overview

Metric
Boreal
GPT-6 Astra
Claude Opus 5.5
GPT-6.1 Sol
Lab
Creatify
OpenAI
Anthropic
OpenAI
Released
Sep 15, 2026
Sep 3, 2026
Sep 22, 2026
Sep 29, 2026
Weights
Proprietary
Proprietary
Proprietary
Proprietary
Input price
$/M tok
—
$10
$4.00
$2.00Best
Output price
$/M tok
—
$50
$20
$10Best
Blended price
$/M tok · 3:1 in:out
—
$20
$8.00
$4.00Best
Output speed
tok/s
—
52
92Best
53
Context
tokens
—
1MBest
1MBest
922K
Price per second
1080p
$0.010
—
—
—

Quality by category

0–100 within each category (100 = best tracked model). Rank is among all models ranked there. Click a row to focus it.

Metric
Boreal
GPT-6 Astra
Claude Opus 5.5
GPT-6.1 Sol
Coding
Not ranked
84.5±4.5
#6/119Verified
95.7±3.6Best
#1/119Mixedbest value
85.7±4.5
#5/119Verified
Writing & chat
Not ranked
89.3±5.3Best
#4/156Verified
88.3±4.3
#5/156Verified
81.9±6.0
#8/156Verified
Vision
Not ranked
98.2±3.3Best
#1/91Verifiedbest value
94.0±4.8
#2/91Verifiedbest value
92.5±6.2
#3/91Verifiedbest value
Hard reasoning
Not ranked
93.6±3.7
#5/200Verified
99.9±2.6Best
#1/200Verifiedbest value
91.6±5.1
#7/200Verified
Agents
Not ranked
81.1±4.6
#15/178Mixed
99.6±4.1Best
#1/178Verifiedbest value
82.5±7.8
#11/178Verified
Video generation
14.7±7.5
#34/36Verifiedbest value
Not ranked
Not ranked
Not ranked

Coding benchmarks

Rank among models with a published score, and the leaderboard around each model. ~ italic = no published score, estimated from related benchmarks.

Metric
Boreal
GPT-6 Astra
Claude Opus 5.5
GPT-6.1 Sol
SWE-bench Verified
day 0
—
~#2/14~89.9%Estimated
  1. #1Claude Opus 596.0%
  2. ~#2GPT-6 AstraEstimated89.9%
  3. #2Claude Sonnet 585.2%
estimated from related benchmarks
~#2/14~94.7%Estimated
  1. #1Claude Opus 596.0%
  2. ~#2Claude Opus 5.5Estimated94.7%
  3. #2Claude Sonnet 585.2%
estimated from related benchmarks
~#2/14~89.6%Estimated
  1. #1Claude Opus 596.0%
  2. ~#2GPT-6.1 SolEstimated89.6%
  3. #2Claude Sonnet 585.2%
estimated from related benchmarks
SWE-bench Pro (Public)
day 0
—
~#5/20~75.0%Estimated
  1. #1Claude Opus 5.589.9%
  2. #4Claude Opus 579.2%
  3. ~#5GPT-6 AstraEstimated75.0%
  4. #5Intern-S2-397B68.5%
estimated from related benchmarks
#1/1989.9%Lab-reported
  1. #1Claude Opus 5.589.9%
  2. #2Claude Sonnet 5.581.3%
www-cdn.anthropic.com · 2026-09-22
~#5/20~75.0%Estimated
  1. #1Claude Opus 5.589.9%
  2. #4Claude Opus 579.2%
  3. ~#5GPT-6.1 SolEstimated75.0%
  4. #5Intern-S2-397B68.5%
estimated from related benchmarks
DeepSWE v1.1
day 0
—
#14/3467.6%Verified
  1. #1Gemini 4 Argon78.8%
  2. #13Step 5 Preview67.7%
  3. #14GPT-6 Astra67.6%
  4. #15GPT-5.567.0%
artificialanalysis.ai · 2026-09-24
#10/3468.4%Verified
  1. #1Gemini 4 Argon78.8%
  2. #9GPT-6 Sol69.0%
  3. #10Claude Opus 5.568.4%
  4. #10Kimi K368.4%
artificialanalysis.ai · 2026-09-24
#3/3473.2%BestVerified
  1. #1Gemini 4 Argon78.8%
  2. #2DeepSeek V4.1 Flash74.2%
  3. #3GPT-6.1 Sol73.2%
  4. #4Grok 4.772.6%
artificialanalysis.ai · 2026-10-02
Terminal-Bench 4.0
day 0
—
#3/8859.1%Verified
  1. #1Claude Sonnet 5.563.6%
  2. #2Claude Opus 5.559.6%
  3. #3GPT-6 Astra59.1%
  4. #4Gemini 4 Argon57.1%
artificialanalysis.ai · 2026-09-24
#2/8859.6%BestVerified
  1. #1Claude Sonnet 5.563.6%
  2. #2Claude Opus 5.559.6%
  3. #3GPT-6 Astra59.1%
artificialanalysis.ai · 2026-09-24
#5/8856.1%Verified
  1. #1Claude Sonnet 5.563.6%
  2. #4Gemini 4 Argon57.1%
  3. #5GPT-6.1 Sol56.1%
  4. #6Claude Fable 5.152.0%
artificialanalysis.ai · 2026-09-29
LiveCodeBench
third-party
—
~#6/25~88.7%Estimated
  1. #1Qwen3.8-Omni-Flash92.6%
  2. #5Nemotron 3 Ultra89.0%
  3. ~#6GPT-6 AstraEstimated88.7%
  4. #6gpt-oss-120b87.8%
estimated from related benchmarks
~#2/25~91.9%Estimated
  1. #1Qwen3.8-Omni-Flash92.6%
  2. ~#2Claude Opus 5.5Estimated91.9%
  3. #2Qwen3.8 Flash-Next91.9%
estimated from related benchmarks
~#7/25~87.3%Estimated
  1. #1Qwen3.8-Omni-Flash92.6%
  2. #6gpt-oss-120b87.8%
  3. ~#7GPT-6.1 SolEstimated87.3%
  4. #7Ternary Bonsai 27B82.8%
estimated from related benchmarks
SciCode
third-party
—
#16/10556.5%Verified
  1. #1Claude Opus 5.566.9%
  2. #15Gemini 3.8 Flash56.6%
  3. #16GPT-6 Astra56.5%
  4. #17Claude Opus 556.4%
artificialanalysis.ai · 2026-09-24
#1/10566.9%BestVerified
  1. #1Claude Opus 5.566.9%
  2. #2Claude Fable 5.163.1%
artificialanalysis.ai · 2026-09-24
#20/10555.7%Verified
  1. #1Claude Opus 5.566.9%
  2. #19GPT-5.555.8%
  3. #20GPT-6.1 Sol55.7%
  4. #21Claude Haiku 5.555.0%
artificialanalysis.ai · 2026-09-29
AA Coding Agent Index
third-party
—
#5/1761.6Verified
  1. #1Claude Opus 5.566.0
  2. #4Claude Fable 5.162.2
  3. #5GPT-6 Astra61.6
  4. #6Claude Opus 559.7
artificialanalysis.ai · 2026-09-24
#1/1766.0BestVerified
  1. #1Claude Opus 5.566.0
  2. #2Gemini 4 Argon63.8
artificialanalysis.ai · 2026-09-24
#3/1762.9Verified
  1. #1Claude Opus 5.566.0
  2. #2Gemini 4 Argon63.8
  3. #3GPT-6.1 Sol62.9
  4. #4Claude Fable 5.162.2
artificialanalysis.ai · 2026-10-02

Writing & chat benchmarks

Rank among models with a published score, and the leaderboard around each model. ~ italic = no published score, estimated from related benchmarks.

Metric
Boreal
GPT-6 Astra
Claude Opus 5.5
GPT-6.1 Sol
IFBench
day 0
—
~#3/134~81.9%Estimated
  1. #1MiniMax-M382.9%
  2. #2Qwen3.8 2.4T A95B82.8%
  3. ~#3GPT-6 AstraEstimated81.9%
  4. #3Qwen3.8-Omni-Flash81.5%
estimated from related benchmarks
~#2/134~82.8%Estimated
  1. #1MiniMax-M382.9%
  2. ~#2Claude Opus 5.5Estimated82.8%
  3. #2Qwen3.8 2.4T A95B82.8%
estimated from related benchmarks
~#3/134~82.0%Estimated
  1. #1MiniMax-M382.9%
  2. #2Qwen3.8 2.4T A95B82.8%
  3. ~#3GPT-6.1 SolEstimated82.0%
  4. #3Qwen3.8-Omni-Flash81.5%
estimated from related benchmarks
MMMLU
day 0
—
~#2/5~91.3%Estimated
  1. #1Gemini 3.1 Pro92.6%
  2. ~#2GPT-6 AstraEstimated91.3%
  3. #2Gemma 4 31B88.4%
estimated from related benchmarks
~#2/5~92.3%Estimated
  1. #1Gemini 3.1 Pro92.6%
  2. ~#2Claude Opus 5.5Estimated92.3%
  3. #2Gemma 4 31B88.4%
estimated from related benchmarks
~#2/5~91.3%Estimated
  1. #1Gemini 3.1 Pro92.6%
  2. ~#2GPT-6.1 SolEstimated91.3%
  3. #2Gemma 4 31B88.4%
estimated from related benchmarks
LMArena Text, Non-English (Elo)
third-party
—
#12/561463VerifiedFew votes
  1. #1Gemini 4 ArgonFew votes1512
  2. #12GLM-5.3 Flash1463
  3. #12GPT-6 AstraFew votes1463
  4. #15MiMo-V2.6-Pro1461
lmarena.ai · 2026-10-02
#3/561494BestVerified
  1. #1Gemini 4 ArgonFew votes1512
  2. #2Claude Fable 5.1Few votes1496
  3. #3Claude Opus 5.51494
  4. #4Muse Spark 1.3Few votes1487
lmarena.ai · 2026-10-02
#11/561469Verified
  1. #1Gemini 4 ArgonFew votes1512
  2. #10Qwen3.8 Max (0902)1470
  3. #11GPT-6.1 Sol1469
  4. #12GLM-5.31463
lmarena.ai · 2026-10-02
LMArena Text (Elo)
third-party
—
#14/561477VerifiedFew votes
  1. #1Gemini 4 Argon1525
  2. #12MiMo-V2.6-Pro1480
  3. #14GPT-6 AstraFew votes1477
  4. #15GLM-5.3 Flash1475
lmarena.ai · 2026-10-02
#2/561504BestVerified
  1. #1Gemini 4 Argon1525
  2. #2Claude Opus 5.51504
  3. #3Claude Fable 5.11501
lmarena.ai · 2026-10-02
#9/561483Verified
  1. #1Gemini 4 Argon1525
  2. #8Gemini 3.1 Pro1487
  3. #9GPT-6.1 Sol1483
  4. #10GPT-5.51482
lmarena.ai · 2026-10-02
EQ-Bench Creative Writing v3 (Elo)
third-party
—
#1/252173BestVerified
  1. #1GPT-6 Astra2173
  2. #2Claude Fable 5.12162
eqbench.com · 2026-09-24
#7/252050Verified
  1. #1GPT-6 Astra2173
  2. #6GLM-5.32075
  3. #7Claude Opus 5.52050
  4. #8Grok 4.72007
eqbench.com · 2026-09-24
~#8/26~2015Estimated
  1. #1GPT-6 Astra2173
  2. #7Claude Opus 5.52050
  3. ~#8GPT-6.1 SolEstimated2015
  4. #8Grok 4.72007
estimated from related benchmarks

Vision benchmarks

Rank among models with a published score, and the leaderboard around each model. ~ italic = no published score, estimated from related benchmarks.

Metric
Boreal
GPT-6 Astra
Claude Opus 5.5
GPT-6.1 Sol
MMMU
day 0
—
~#2/3~71.3%Estimated
  1. #1Claude Haiku 4.573.2%
  2. ~#2GPT-6 AstraEstimated71.3%
  3. #2Llama 4 Maverick69.4%
estimated from related benchmarks
~#2/3~71.3%Estimated
  1. #1Claude Haiku 4.573.2%
  2. ~#2Claude Opus 5.5Estimated71.3%
  3. #2Llama 4 Maverick69.4%
estimated from related benchmarks
~#2/3~71.3%Estimated
  1. #1Claude Haiku 4.573.2%
  2. ~#2GPT-6.1 SolEstimated71.3%
  3. #2Llama 4 Maverick69.4%
estimated from related benchmarks
MMMU-Pro
day 0
—
#2/8586.9%Verified
  1. #1Claude Opus 5.587.7%
  2. #2GPT-6 Astra86.9%
  3. #3GPT-6.1 Sol86.0%
artificialanalysis.ai · 2026-09-24
#1/8587.7%BestVerified
  1. #1Claude Opus 5.587.7%
  2. #2GPT-6 Astra86.9%
artificialanalysis.ai · 2026-09-24
#3/8586.0%Verified
  1. #1Claude Opus 5.587.7%
  2. #2GPT-6 Astra86.9%
  3. #3GPT-6.1 Sol86.0%
  4. #4Gemini 3.8 Flash85.6%
artificialanalysis.ai · 2026-09-29
CharXiv Reasoning
day 0
—
~#2/9~86.1%Estimated
  1. #1Gemini 3.8 Flash86.2%
  2. ~#2GPT-6 AstraEstimated86.1%
  3. #2Kimi K384.8%
estimated from related benchmarks
~#2/9~86.1%Estimated
  1. #1Gemini 3.8 Flash86.2%
  2. ~#2Claude Opus 5.5Estimated86.1%
  3. #2Kimi K384.8%
estimated from related benchmarks
~#2/9~85.9%Estimated
  1. #1Gemini 3.8 Flash86.2%
  2. ~#2GPT-6.1 SolEstimated85.9%
  3. #2Kimi K384.8%
estimated from related benchmarks
OmniDocBench v1.5
third-party
—
~#2/8~91.4%Estimated
  1. #1MiniMax-M391.6%
  2. ~#2GPT-6 AstraEstimated91.4%
  3. #2Kimi K391.1%
estimated from related benchmarks
~#2/8~91.4%Estimated
  1. #1MiniMax-M391.6%
  2. ~#2Claude Opus 5.5Estimated91.4%
  3. #2Kimi K391.1%
estimated from related benchmarks
~#2/8~91.1%Estimated
  1. #1MiniMax-M391.6%
  2. ~#2GPT-6.1 SolEstimated91.1%
  3. #2Kimi K391.1%
estimated from related benchmarks
GDP.pdf (AA)
third-party
—
#2/4331.0%Verified
  1. #1GPT-6.1 Sol32.0%
  2. #2GPT-6 Astra31.0%
  3. #3Muse Spark 1.326.6%
artificialanalysis.ai · 2026-09-24
#4/4326.2%Verified
  1. #1GPT-6.1 Sol32.0%
  2. #4Claude Fable 5.126.2%
  3. #4Claude Opus 5.526.2%
  4. #6GPT-6 Sol24.8%
artificialanalysis.ai · 2026-09-24
#1/4332.0%BestVerified
  1. #1GPT-6.1 Sol32.0%
  2. #2GPT-6 Astra31.0%
artificialanalysis.ai · 2026-10-07
Chartography
third-party
—
#1/2371.0%BestVerified
  1. #1GPT-6 Astra71.0%
  2. #2Claude Opus 5.566.3%
surgehq.ai · 2026-09-24
#2/2366.3%Verified
  1. #1GPT-6 Astra71.0%
  2. #2Claude Opus 5.566.3%
  3. #3GPT-6 Sol53.6%
surgehq.ai · 2026-09-24
~#4/24~47.0%Estimated
  1. #1GPT-6 Astra71.0%
  2. #3GPT-6 Sol53.6%
  3. ~#4GPT-6.1 SolEstimated47.0%
  4. #4Claude Haiku 5.546.4%
estimated from related benchmarks

Hard reasoning benchmarks

Rank among models with a published score, and the leaderboard around each model. ~ italic = no published score, estimated from related benchmarks.

Metric
Boreal
GPT-6 Astra
Claude Opus 5.5
GPT-6.1 Sol
GPQA Diamond
day 0
—
#1/18396.1%Verified
  1. #1GPT-6 Astra96.1%
  2. #2Gemini 3.8 Flash95.3%
artificialanalysis.ai · 2026-09-24
~#2/184~96.1%Estimated
  1. #1GPT-6 Astra96.1%
  2. ~#2Claude Opus 5.5Estimated96.1%
  3. #2Gemini 3.8 Flash95.3%
estimated from related benchmarks
~#2/184~96.1%Estimated
  1. #1GPT-6 Astra96.1%
  2. ~#2GPT-6.1 SolEstimated96.1%
  3. #2Gemini 3.8 Flash95.3%
estimated from related benchmarks
Humanity's Last Exam
day 0
—
#6/18454.7%Verified
  1. #1Claude Opus 5.561.4%
  2. #5Claude Opus 554.9%
  3. #6GPT-6 Astra54.7%
  4. #7GPT-6.1 Sol52.9%
artificialanalysis.ai · 2026-09-24
#1/18461.4%BestVerified
  1. #1Claude Opus 5.561.4%
  2. #2Claude Fable 5.159.1%
artificialanalysis.ai · 2026-09-24
#7/18452.9%Verified
  1. #1Claude Opus 5.561.4%
  2. #6GPT-6 Astra54.7%
  3. #7GPT-6.1 Sol52.9%
  4. #8MiMo-V2.6-Pro49.4%
artificialanalysis.ai · 2026-09-29
AIME (latest)
day 0
—
~#2/32~99.4%Estimated
  1. #1GLM-5.3 NVFP499.5%
  2. ~#2GPT-6 AstraEstimated99.4%
  3. #2Inkling97.1%
estimated from related benchmarks
~#2/32~99.2%Estimated
  1. #1GLM-5.3 NVFP499.5%
  2. ~#2Claude Opus 5.5Estimated99.2%
  3. #2Inkling97.1%
estimated from related benchmarks
~#2/32~99.1%Estimated
  1. #1GLM-5.3 NVFP499.5%
  2. ~#2GPT-6.1 SolEstimated99.1%
  3. #2Inkling97.1%
estimated from related benchmarks
AA Intelligence Index
third-party
—
#4/8552.7Verified
  1. #1Claude Opus 5.557.6
  2. #3Claude Fable 5.153.4
  3. #4GPT-6 Astra52.7
  4. #5Gemini 4 Argon52.6
artificialanalysis.ai · 2026-09-24
#1/8557.6BestVerified
  1. #1Claude Opus 5.557.6
  2. #2Claude Sonnet 5.556.0
artificialanalysis.ai · 2026-09-24
#6/8551.8Verified
  1. #1Claude Opus 5.557.6
  2. #5Gemini 4 Argon52.6
  3. #6GPT-6.1 Sol51.8
  4. #7Claude Opus 550.8
artificialanalysis.ai · 2026-09-29

Agents benchmarks

Rank among models with a published score, and the leaderboard around each model. ~ italic = no published score, estimated from related benchmarks.

Metric
Boreal
GPT-6 Astra
Claude Opus 5.5
GPT-6.1 Sol
τ²-bench (Telecom)
day 0
—
~#2/118~98.3%Estimated
  1. #1Step 3.7 Flash98.5%
  2. ~#2GPT-6 AstraEstimated98.3%
  3. #2DeepSeek-V4-Pro-0813-nvfp4-DSpark98.3%
estimated from related benchmarks
~#2/118~98.3%Estimated
  1. #1Step 3.7 Flash98.5%
  2. ~#2Claude Opus 5.5Estimated98.3%
  3. #2DeepSeek-V4-Pro-0813-nvfp4-DSpark98.3%
estimated from related benchmarks
~#3/118~98.2%Estimated
  1. #1Step 3.7 Flash98.5%
  2. #2DeepSeek-V4-Pro-0813-nvfp4-DSpark98.3%
  3. ~#3GPT-6.1 SolEstimated98.2%
  4. #3Gemini 3.1 Pro95.6%
estimated from related benchmarks
OSWorld-Verified
day 0
—
~#3/12~83.3%Estimated
  1. #1Kimi K384.8%
  2. #2Qwen3.8 27B84.3%
  3. ~#3GPT-6 AstraEstimated83.3%
  4. #3Nex-N2.5-Pro82.2%
estimated from related benchmarks
~#2/12~84.6%Estimated
  1. #1Kimi K384.8%
  2. ~#2Claude Opus 5.5Estimated84.6%
  3. #2Qwen3.8 27B84.3%
estimated from related benchmarks
~#3/12~83.7%Estimated
  1. #1Kimi K384.8%
  2. #2Qwen3.8 27B84.3%
  3. ~#3GPT-6.1 SolEstimated83.7%
  4. #3Nex-N2.5-Pro82.2%
estimated from related benchmarks
OSWorld 2.0
day 0
—
~#3/5~54.9%Estimated
  1. #1GLM-5.3 Flash59.1%
  2. #2Kimi K358.3%
  3. ~#3GPT-6 AstraEstimated54.9%
  4. #3GPT-5.6 Terra50.2%
estimated from related benchmarks
~#2/5~58.6%Estimated
  1. #1GLM-5.3 Flash59.1%
  2. ~#2Claude Opus 5.5Estimated58.6%
  3. #2Kimi K358.3%
estimated from related benchmarks
~#3/5~56.9%Estimated
  1. #1GLM-5.3 Flash59.1%
  2. #2Kimi K358.3%
  3. ~#3GPT-6.1 SolEstimated56.9%
  4. #3GPT-5.6 Terra50.2%
estimated from related benchmarks
BrowseComp
day 0
—
#2/1791.5%Lab-reported
  1. #1Atria Dawn Preview92.5%
  2. #2GPT-6 Astra91.5%
  3. #3Kimi K391.2%
openai.com · 2026-09-03
~#2/18~92.3%Estimated
  1. #1Atria Dawn Preview92.5%
  2. ~#2Claude Opus 5.5Estimated92.3%
  3. #2GPT-6 Astra91.5%
estimated from related benchmarks
~#5/18~90.7%Estimated
  1. #1Atria Dawn Preview92.5%
  2. #4Claude Opus 590.8%
  3. ~#5GPT-6.1 SolEstimated90.7%
  4. #5Nex-N2.5-Pro89.7%
estimated from related benchmarks
GDPval-AA (Elo)
third-party
—
#16/871542Verified
  1. #1Claude Opus 5.51866
  2. #15Step 5 Preview1566
  3. #16GPT-6 Astra1542
  4. #17Kimi K31524
artificialanalysis.ai · 2026-09-24
#1/871866BestVerified
  1. #1Claude Opus 5.51866
  2. #2Claude Fable 5.11758
artificialanalysis.ai · 2026-10-07
#14/871575Verified
  1. #1Claude Opus 5.51866
  2. #13Qwen3.8 2.4T A95B1597
  3. #14GPT-6.1 Sol1575
  4. #15Step 5 Preview1566
artificialanalysis.ai · 2026-10-07
AutomationBench-AA
third-party
—
#3/8168.5%Verified
  1. #1Claude Opus 5.569.5%
  2. #2DeepSeek V4.1 Flash68.9%
  3. #3GPT-6 Astra68.5%
  4. #4Grok 4.667.0%
artificialanalysis.ai · 2026-09-24
#1/8169.5%BestVerified
  1. #1Claude Opus 5.569.5%
  2. #2DeepSeek V4.1 Flash68.9%
artificialanalysis.ai · 2026-09-24
#5/8166.6%Verified
  1. #1Claude Opus 5.569.5%
  2. #4Grok 4.667.0%
  3. #5GPT-6.1 Sol66.6%
  4. #6Grok 4.765.6%
artificialanalysis.ai · 2026-10-07
τ-Bench Banking (AA)
third-party
—
#13/8941.4%Verified
  1. #1Muse Spark 1.350.5%
  2. #12Claude Opus 542.1%
  3. #13GPT-6 Astra41.4%
  4. #14GPT-5.6 Terra40.2%
artificialanalysis.ai · 2026-09-24
~#3/90~50.1%Estimated
  1. #1Muse Spark 1.350.5%
  2. #2GLM-5.350.3%
  3. ~#3Claude Opus 5.5Estimated50.1%
  4. #3Qwen3.8 2.4T A95B49.1%
estimated from related benchmarks
~#10/90~45.0%Estimated
  1. #1Muse Spark 1.350.5%
  2. #9Qwen3.8 Flash-Next45.4%
  3. ~#10GPT-6.1 SolEstimated45.0%
  4. #10Gemini 3.8 Flash44.9%
estimated from related benchmarks
Not comparable across labs (2)
OSWorld 2.0 (Sept 2026 release)
day 0
—
—
#1/381.8%Lab-reported
  1. #1Claude Opus 5.581.8%
  2. #2Claude Fable 5.180.7%
anthropic.com · 2026-09-22
—
OSWorld 2.0 (offline set v2026.08.08)
day 0
—
#1/472.6%BestLab-reported
  1. #1GPT-6 Astra72.6%
  2. #2GPT-6.1 Sol71.4%
openai.com · 2026-09-03
—
#2/471.4%Lab-reported
  1. #1GPT-6 Astra72.6%
  2. #2GPT-6.1 Sol71.4%
  3. #3GPT-6 Sol64.4%
vellum.ai · 2026-09-29

Video generation benchmarks

Rank among models with a published score, and the leaderboard around each model. ~ italic = no published score, estimated from related benchmarks.

Metric
Boreal
GPT-6 Astra
Claude Opus 5.5
GPT-6.1 Sol
AA Text-to-Video Arena
third-party
#25/25841VerifiedFew votes
  1. #1Wan 3.0Few votes1128
  2. #24Pika 2.5850
  3. #25BorealFew votes841
artificialanalysis.ai · 2026-10-07
—
—
—
AA Image-to-Video Arena
third-party
~#26/28~1208Estimated
  1. #1Gemini Omni Flash1369
  2. #25LTX-2.5 FastFew votes1214
  3. ~#26BorealEstimated1208
  4. #26Pika 2.51202
estimated from related benchmarks
—
—
—
AA Text-to-Video Arena (with audio)
third-party
#23/23838VerifiedFew votes
  1. #1Wan 3.01157
  2. #22Vidu Q3 Pro941
  3. #23BorealFew votes838
artificialanalysis.ai · 2026-10-07
—
—
—
AA Image-to-Video Arena (with audio)
third-party
~last/25below measured range (<1000)Estimated
  1. #1MiniMax H31195
  2. #24Seedance 1.5 pro1000
  3. ~#25BorealEstimated<1000
estimated from related benchmarks
—
—
—
LMArena Text-to-Video
third-party
~#14/18~1267Estimated
  1. #1Gemini Omni 1.1 FlashFew votes1516
  2. #13Wan 2.71337
  3. ~#14BorealEstimated1267
  4. #14Seedance 1.5 pro1256
estimated from related benchmarks
—
—
—
LMArena Image-to-Video
third-party
~#17/20~1319Estimated
  1. #1MiniMax H31495
  2. #16Kling 3.0 Pro (1080p)1354
  3. ~#17BorealEstimated1319
  4. #17Seedance 1.5 pro1307
estimated from related benchmarks
—
—
—
VBench
day 0
—
—
—
—