Skip to content
Model Pareto

GPT-6 Astra vs Claude Fable 5.1

GPT-6 Astra scores higher in vision; Claude Fable 5.1 in coding, writing & chat, hard reasoning and agents. Both cost about $20.0 per million tokens, blended 3:1 input:output.
GPT-6 AstraClaude Fable 5.1
Focus

Coding: quality vs price

Compared models are ringed; the other 117 ranked here are greyed.

Lower price is better. Pareto frontier: Nex-N2.5-Mini, Nex-N2.5-Pro, MiMo-V2.6-Flash, Ternary Bonsai 2 27B, MiMo-V2.6-Pro, Gemini 4 Argon, Claude Opus 5.5. 34 models are not plotted: GLM-5.3 Flash NVFP4, DeepSeek V4.1 Flash NVFP4, GLM-5.3 NVFP4, DeepSeek-V4-Pro-0813-nvfp4-DSpark, Xing4.0-29B-A4B, Ternary Bonsai 27B, Atria Dawn Preview, Maple-Preview, Bonsai 27B, Qwen3.8 27B NVFP4, Intern-S2-397B, Phi-4-reasoning-plus, Solar Open2 250B, Laguna S 2.1, Motif 3, Nex-N2-Pro, K-EXAONE 2.0 0803, K2 Horizon 375B A23B, A.X-K2, K2 Horizon MoVA 36B A4B, Intern-S2-Preview (35B-A3B), North Mini Code, G9v3-39A5B, Falcon-H1-34B-Instruct, Qwen3.8 Flash-Next NVFP4, Devstral 2, K2 Horizon 7B, K2-Horizon-32B, Devstral Small 2, MiniCPM5-2B, Ling 3.0 Tiny, K2 Horizon 3.7B, K2 Horizon 0.9B, LFM2.5-2.6B.

34 models with no price data — shown in the strip at the left edge

GLM-5.3 Flash NVFP4, DeepSeek V4.1 Flash NVFP4, GLM-5.3 NVFP4, DeepSeek-V4-Pro-0813-nvfp4-DSpark, Xing4.0-29B-A4B, Ternary Bonsai 27B, Atria Dawn Preview, Maple-Preview, Bonsai 27B, Qwen3.8 27B NVFP4, Intern-S2-397B, Phi-4-reasoning-plus, Solar Open2 250B, Laguna S 2.1, Motif 3, Nex-N2-Pro, K-EXAONE 2.0 0803, K2 Horizon 375B A23B, A.X-K2, K2 Horizon MoVA 36B A4B, Intern-S2-Preview (35B-A3B), North Mini Code, G9v3-39A5B, Falcon-H1-34B-Instruct, Qwen3.8 Flash-Next NVFP4, Devstral 2, K2 Horizon 7B, K2-Horizon-32B, Devstral Small 2, MiniCPM5-2B, Ling 3.0 Tiny, K2 Horizon 3.7B, K2 Horizon 0.9B, LFM2.5-2.6B

  • Best-value frontier (nothing is both cheaper and better)
  • Evidencestrong → weak
  • Estimated from other categories
  • GPT-6 Astra
    Quality
    84.5
    Rank
    #6/119
    Price
    $20.0/M tok
    Speed
    52tok/s
    In$10▾Out$50▾/M tok

    vs Claude Fable 5.1: −1.7 quality · 1× price

  • Claude Fable 5.1
    Quality
    86.2
    Rank
    #4/119
    Price
    $20.0/M tok
    Speed
    48tok/s
    In$10▾Out$50▾/M tok

    vs GPT-6 Astra: +1.7 quality · 1× price

Overview

Metric
GPT-6 Astra
Claude Fable 5.1
Lab
OpenAI
Anthropic
Released
Sep 3, 2026
Sep 1, 2026
Weights
Proprietary
Proprietary
Input price
$/M tok
$10Best
$10Best
Output price
$/M tok
$50Best
$50Best
Blended price
$/M tok · 3:1 in:out
$20Best
$20Best
Output speed
tok/s
52Best
48
Context
tokens
1MBest
1MBest

Quality by category

0–100 within each category (100 = best tracked model). Rank is among all models ranked there. Click a row to focus it.

Metric
GPT-6 Astra
Claude Fable 5.1
Coding
84.5±4.5
#6/119Verified
86.2±3.6Best
#4/119Mixed
Writing & chat
89.3±5.3
#4/156Verified
94.4±4.6Best
#2/156Verified
Vision
98.2±3.3Best
#1/91Verifiedbest value
86.7±7.3
#4/91Verified
Hard reasoning
93.6±3.7
#5/200Verified
95.7±3.7Best
#2/200Verified
Agents
81.1±4.6
#15/178Mixed
89.8±5.8Best
#2/178Verified

Coding benchmarks

Rank among models with a published score, and the leaderboard around each model. ~ italic = no published score, estimated from related benchmarks.

Metric
GPT-6 Astra
Claude Fable 5.1
SWE-bench Verified
day 0
~#2/14~89.9%Estimated
  1. #1Claude Opus 596.0%
  2. ~#2GPT-6 AstraEstimated89.9%
  3. #2Claude Sonnet 585.2%
estimated from related benchmarks
~#2/14~93.5%Estimated
  1. #1Claude Opus 596.0%
  2. ~#2Claude Fable 5.1Estimated93.5%
  3. #2Claude Sonnet 585.2%
estimated from related benchmarks
SWE-bench Pro (Public)
day 0
~#5/20~75.0%Estimated
  1. #1Claude Opus 5.589.9%
  2. #4Claude Opus 579.2%
  3. ~#5GPT-6 AstraEstimated75.0%
  4. #5Intern-S2-397B68.5%
estimated from related benchmarks
#3/1981.2%Lab-reported
  1. #1Claude Opus 5.589.9%
  2. #2Claude Sonnet 5.581.3%
  3. #3Claude Fable 5.181.2%
  4. #4Claude Opus 579.2%
anthropic.com · 2026-09-01
DeepSWE v1.1
day 0
#14/3467.6%BestVerified
  1. #1Gemini 4 Argon78.8%
  2. #13Step 5 Preview67.7%
  3. #14GPT-6 Astra67.6%
  4. #15GPT-5.567.0%
artificialanalysis.ai · 2026-09-24
#18/3464.3%Verified
  1. #1Gemini 4 Argon78.8%
  2. #17Grok 4.664.9%
  3. #18Claude Fable 5.164.3%
  4. #18Hy4 preview64.3%
artificialanalysis.ai · 2026-09-24
Terminal-Bench 4.0
day 0
#3/8859.1%BestVerified
  1. #1Claude Sonnet 5.563.6%
  2. #2Claude Opus 5.559.6%
  3. #3GPT-6 Astra59.1%
  4. #4Gemini 4 Argon57.1%
artificialanalysis.ai · 2026-09-24
#6/8852.0%Verified
  1. #1Claude Sonnet 5.563.6%
  2. #5GPT-6.1 Sol56.1%
  3. #6Claude Fable 5.152.0%
  4. #7Claude Opus 549.0%
artificialanalysis.ai · 2026-09-24
LiveCodeBench
third-party
~#6/25~88.7%Estimated
  1. #1Qwen3.8-Omni-Flash92.6%
  2. #5Nemotron 3 Ultra89.0%
  3. ~#6GPT-6 AstraEstimated88.7%
  4. #6gpt-oss-120b87.8%
estimated from related benchmarks
~#4/25~90.3%Estimated
  1. #1Qwen3.8-Omni-Flash92.6%
  2. #3Qwen3.8 27B90.3%
  3. ~#4Claude Fable 5.1Estimated90.3%
  4. #4Ternary Bonsai 2 27B90.1%
estimated from related benchmarks
SciCode
third-party
#16/10556.5%Verified
  1. #1Claude Opus 5.566.9%
  2. #15Gemini 3.8 Flash56.6%
  3. #16GPT-6 Astra56.5%
  4. #17Claude Opus 556.4%
artificialanalysis.ai · 2026-09-24
#2/10563.1%BestVerified
  1. #1Claude Opus 5.566.9%
  2. #2Claude Fable 5.163.1%
  3. #3Gemini 4 Argon61.8%
artificialanalysis.ai · 2026-09-24
AA Coding Agent Index
third-party
#5/1761.6Verified
  1. #1Claude Opus 5.566.0
  2. #4Claude Fable 5.162.2
  3. #5GPT-6 Astra61.6
  4. #6Claude Opus 559.7
artificialanalysis.ai · 2026-09-24
#4/1762.2BestVerified
  1. #1Claude Opus 5.566.0
  2. #3GPT-6.1 Sol62.9
  3. #4Claude Fable 5.162.2
  4. #5GPT-6 Astra61.6
artificialanalysis.ai · 2026-09-24
Benchmarks in other categories (4)

Writing & chat benchmarks

Rank among models with a published score, and the leaderboard around each model. ~ italic = no published score, estimated from related benchmarks.

Metric
GPT-6 Astra
Claude Fable 5.1
IFBench
day 0
~#3/134~81.9%Estimated
  1. #1MiniMax-M382.9%
  2. #2Qwen3.8 2.4T A95B82.8%
  3. ~#3GPT-6 AstraEstimated81.9%
  4. #3Qwen3.8-Omni-Flash81.5%
estimated from related benchmarks
~#2/134~82.8%Estimated
  1. #1MiniMax-M382.9%
  2. ~#2Claude Fable 5.1Estimated82.8%
  3. #2Qwen3.8 2.4T A95B82.8%
estimated from related benchmarks
MMMLU
day 0
~#2/5~91.3%Estimated
  1. #1Gemini 3.1 Pro92.6%
  2. ~#2GPT-6 AstraEstimated91.3%
  3. #2Gemma 4 31B88.4%
estimated from related benchmarks
~#2/5~92.4%Estimated
  1. #1Gemini 3.1 Pro92.6%
  2. ~#2Claude Fable 5.1Estimated92.4%
  3. #2Gemma 4 31B88.4%
estimated from related benchmarks
LMArena Text, Non-English (Elo)
third-party
#12/561463VerifiedFew votes
  1. #1Gemini 4 ArgonFew votes1512
  2. #12GLM-5.3 Flash1463
  3. #12GPT-6 AstraFew votes1463
  4. #15MiMo-V2.6-Pro1461
lmarena.ai · 2026-10-02
#2/561496BestVerifiedFew votes
  1. #1Gemini 4 ArgonFew votes1512
  2. #2Claude Fable 5.1Few votes1496
  3. #3Claude Opus 5.51494
lmarena.ai · 2026-09-25
LMArena Text (Elo)
third-party
#14/561477VerifiedFew votes
  1. #1Gemini 4 Argon1525
  2. #12MiMo-V2.6-Pro1480
  3. #14GPT-6 AstraFew votes1477
  4. #15GLM-5.3 Flash1475
lmarena.ai · 2026-10-02
#3/561501BestVerified
  1. #1Gemini 4 Argon1525
  2. #2Claude Opus 5.51504
  3. #3Claude Fable 5.11501
  4. #4Gemini 3.8 Flash1493
lmarena.ai · 2026-09-25
EQ-Bench Creative Writing v3 (Elo)
third-party
#1/252173BestVerified
  1. #1GPT-6 Astra2173
  2. #2Claude Fable 5.12162
eqbench.com · 2026-09-24
#2/252162Verified
  1. #1GPT-6 Astra2173
  2. #2Claude Fable 5.12162
  3. #3Claude Opus 52133
eqbench.com · 2026-09-24

Vision benchmarks

Rank among models with a published score, and the leaderboard around each model. ~ italic = no published score, estimated from related benchmarks.

Metric
GPT-6 Astra
Claude Fable 5.1
MMMU
day 0
~#2/3~71.3%Estimated
  1. #1Claude Haiku 4.573.2%
  2. ~#2GPT-6 AstraEstimated71.3%
  3. #2Llama 4 Maverick69.4%
estimated from related benchmarks
~#2/3~71.3%Estimated
  1. #1Claude Haiku 4.573.2%
  2. ~#2Claude Fable 5.1Estimated71.3%
  3. #2Llama 4 Maverick69.4%
estimated from related benchmarks
MMMU-Pro
day 0
#2/8586.9%Verified
  1. #1Claude Opus 5.587.7%
  2. #2GPT-6 Astra86.9%
  3. #3GPT-6.1 Sol86.0%
artificialanalysis.ai · 2026-09-24
~#2/86~87.3%Estimated
  1. #1Claude Opus 5.587.7%
  2. ~#2Claude Fable 5.1Estimated87.3%
  3. #2GPT-6 Astra86.9%
estimated from related benchmarks
CharXiv Reasoning
day 0
~#2/9~86.1%Estimated
  1. #1Gemini 3.8 Flash86.2%
  2. ~#2GPT-6 AstraEstimated86.1%
  3. #2Kimi K384.8%
estimated from related benchmarks
~#2/9~86.0%Estimated
  1. #1Gemini 3.8 Flash86.2%
  2. ~#2Claude Fable 5.1Estimated86.0%
  3. #2Kimi K384.8%
estimated from related benchmarks
OmniDocBench v1.5
third-party
~#2/8~91.4%Estimated
  1. #1MiniMax-M391.6%
  2. ~#2GPT-6 AstraEstimated91.4%
  3. #2Kimi K391.1%
estimated from related benchmarks
~#2/8~91.2%Estimated
  1. #1MiniMax-M391.6%
  2. ~#2Claude Fable 5.1Estimated91.2%
  3. #2Kimi K391.1%
estimated from related benchmarks
GDP.pdf (AA)
third-party
#2/4331.0%BestVerified
  1. #1GPT-6.1 Sol32.0%
  2. #2GPT-6 Astra31.0%
  3. #3Muse Spark 1.326.6%
artificialanalysis.ai · 2026-09-24
#4/4326.2%Verified
  1. #1GPT-6.1 Sol32.0%
  2. #3Muse Spark 1.326.6%
  3. #4Claude Fable 5.126.2%
  4. #4Claude Opus 5.526.2%
artificialanalysis.ai · 2026-09-24
Chartography
third-party
#1/2371.0%BestVerified
  1. #1GPT-6 Astra71.0%
  2. #2Claude Opus 5.566.3%
surgehq.ai · 2026-09-24
#5/2346.2%Verified
  1. #1GPT-6 Astra71.0%
  2. #4Claude Haiku 5.546.4%
  3. #5Claude Fable 5.146.2%
  4. #6Gemini 3.8 Flash40.9%
surgehq.ai · 2026-09-24

Hard reasoning benchmarks

Rank among models with a published score, and the leaderboard around each model. ~ italic = no published score, estimated from related benchmarks.

Metric
GPT-6 Astra
Claude Fable 5.1
GPQA Diamond
day 0
#1/18396.1%BestVerified
  1. #1GPT-6 Astra96.1%
  2. #2Gemini 3.8 Flash95.3%
artificialanalysis.ai · 2026-09-24
#4/18393.7%Verified
  1. #1GPT-6 Astra96.1%
  2. #3Gemini 3.1 Pro94.1%
  3. #4Claude Fable 5.193.7%
  4. #5GPT-5.593.5%
artificialanalysis.ai · 2026-09-24
Humanity's Last Exam
day 0
#6/18454.7%Verified
  1. #1Claude Opus 5.561.4%
  2. #5Claude Opus 554.9%
  3. #6GPT-6 Astra54.7%
  4. #7GPT-6.1 Sol52.9%
artificialanalysis.ai · 2026-09-24
#2/18459.1%BestVerified
  1. #1Claude Opus 5.561.4%
  2. #2Claude Fable 5.159.1%
  3. #3Gemini 4 Argon57.1%
artificialanalysis.ai · 2026-09-24
AIME (latest)
day 0
~#2/32~99.4%Estimated
  1. #1GLM-5.3 NVFP499.5%
  2. ~#2GPT-6 AstraEstimated99.4%
  3. #2Inkling97.1%
estimated from related benchmarks
~#2/32~99.4%Estimated
  1. #1GLM-5.3 NVFP499.5%
  2. ~#2Claude Fable 5.1Estimated99.4%
  3. #2Inkling97.1%
estimated from related benchmarks
AA Intelligence Index
third-party
#4/8552.7Verified
  1. #1Claude Opus 5.557.6
  2. #3Claude Fable 5.153.4
  3. #4GPT-6 Astra52.7
  4. #5Gemini 4 Argon52.6
artificialanalysis.ai · 2026-09-24
#3/8553.4BestVerified
  1. #1Claude Opus 5.557.6
  2. #2Claude Sonnet 5.556.0
  3. #3Claude Fable 5.153.4
  4. #4GPT-6 Astra52.7
artificialanalysis.ai · 2026-09-24

Agents benchmarks

Rank among models with a published score, and the leaderboard around each model. ~ italic = no published score, estimated from related benchmarks.

Metric
GPT-6 Astra
Claude Fable 5.1
τ²-bench (Telecom)
day 0
~#2/118~98.3%Estimated
  1. #1Step 3.7 Flash98.5%
  2. ~#2GPT-6 AstraEstimated98.3%
  3. #2DeepSeek-V4-Pro-0813-nvfp4-DSpark98.3%
estimated from related benchmarks
~#2/118~98.3%Estimated
  1. #1Step 3.7 Flash98.5%
  2. ~#2Claude Fable 5.1Estimated98.3%
  3. #2DeepSeek-V4-Pro-0813-nvfp4-DSpark98.3%
estimated from related benchmarks
OSWorld-Verified
day 0
~#3/12~83.3%Estimated
  1. #1Kimi K384.8%
  2. #2Qwen3.8 27B84.3%
  3. ~#3GPT-6 AstraEstimated83.3%
  4. #3Nex-N2.5-Pro82.2%
estimated from related benchmarks
~#2/12~84.6%Estimated
  1. #1Kimi K384.8%
  2. ~#2Claude Fable 5.1Estimated84.6%
  3. #2Qwen3.8 27B84.3%
estimated from related benchmarks
OSWorld 2.0
day 0
~#3/5~54.9%Estimated
  1. #1GLM-5.3 Flash59.1%
  2. #2Kimi K358.3%
  3. ~#3GPT-6 AstraEstimated54.9%
  4. #3GPT-5.6 Terra50.2%
estimated from related benchmarks
~#3/5~58.0%Estimated
  1. #1GLM-5.3 Flash59.1%
  2. #2Kimi K358.3%
  3. ~#3Claude Fable 5.1Estimated58.0%
  4. #3GPT-5.6 Terra50.2%
estimated from related benchmarks
BrowseComp
day 0
#2/1791.5%Lab-reported
  1. #1Atria Dawn Preview92.5%
  2. #2GPT-6 Astra91.5%
  3. #3Kimi K391.2%
openai.com · 2026-09-03
~#2/18~92.2%Estimated
  1. #1Atria Dawn Preview92.5%
  2. ~#2Claude Fable 5.1Estimated92.2%
  3. #2GPT-6 Astra91.5%
estimated from related benchmarks
GDPval-AA (Elo)
third-party
#16/871542Verified
  1. #1Claude Opus 5.51866
  2. #15Step 5 Preview1566
  3. #16GPT-6 Astra1542
  4. #17Kimi K31524
artificialanalysis.ai · 2026-09-24
#2/871758BestVerified
  1. #1Claude Opus 5.51866
  2. #2Claude Fable 5.11758
  3. #3Claude Opus 51724
artificialanalysis.ai · 2026-10-07
AutomationBench-AA
third-party
#3/8168.5%BestVerified
  1. #1Claude Opus 5.569.5%
  2. #2DeepSeek V4.1 Flash68.9%
  3. #3GPT-6 Astra68.5%
  4. #4Grok 4.667.0%
artificialanalysis.ai · 2026-09-24
#13/8159.4%Verified
  1. #1Claude Opus 5.569.5%
  2. #12GPT-5.6 Terra59.6%
  3. #13Claude Fable 5.159.4%
  4. #14MiMo-V2.6-Pro58.6%
artificialanalysis.ai · 2026-09-24
τ-Bench Banking (AA)
third-party
#13/8941.4%Verified
  1. #1Muse Spark 1.350.5%
  2. #12Claude Opus 542.1%
  3. #13GPT-6 Astra41.4%
  4. #14GPT-5.6 Terra40.2%
artificialanalysis.ai · 2026-09-24
#6/8947.2%BestVerified
  1. #1Muse Spark 1.350.5%
  2. #5Qwen3.8 Max (0902)47.8%
  3. #6Claude Fable 5.147.2%
  4. #6GLM-5.3 Flash47.2%
artificialanalysis.ai · 2026-09-24
Not comparable across labs (2)
OSWorld 2.0 (Sept 2026 release)
day 0
—
#2/380.7%Lab-reported
  1. #1Claude Opus 5.581.8%
  2. #2Claude Fable 5.180.7%
  3. #3Claude Opus 574.0%
anthropic.com · 2026-09-22
OSWorld 2.0 (offline set v2026.08.08)
day 0
#1/472.6%Lab-reported
  1. #1GPT-6 Astra72.6%
  2. #2GPT-6.1 Sol71.4%
openai.com · 2026-09-03
—