Skip to content
Model Pareto

Grok 4.7 vs GPT-6 Sol

Grok 4.7 scores higher in agents; GPT-6 Sol in coding, writing & chat, vision and hard reasoning. GPT-6 Sol costs 1.3× as much as Grok 4.7 ($4.00 vs $3.00 per million tokens, blended 3:1 input:output).
Grok 4.7GPT-6 Sol
Focus

Coding: quality vs price

Compared models are ringed; the other 117 ranked here are greyed.

Lower price is better. Pareto frontier: Nex-N2.5-Mini, Nex-N2.5-Pro, MiMo-V2.6-Flash, Ternary Bonsai 2 27B, MiMo-V2.6-Pro, Gemini 4 Argon, Claude Opus 5.5. 34 models are not plotted: GLM-5.3 Flash NVFP4, DeepSeek V4.1 Flash NVFP4, GLM-5.3 NVFP4, DeepSeek-V4-Pro-0813-nvfp4-DSpark, Xing4.0-29B-A4B, Ternary Bonsai 27B, Atria Dawn Preview, Maple-Preview, Bonsai 27B, Qwen3.8 27B NVFP4, Intern-S2-397B, Phi-4-reasoning-plus, Solar Open2 250B, Laguna S 2.1, Motif 3, Nex-N2-Pro, K-EXAONE 2.0 0803, K2 Horizon 375B A23B, A.X-K2, K2 Horizon MoVA 36B A4B, Intern-S2-Preview (35B-A3B), North Mini Code, G9v3-39A5B, Falcon-H1-34B-Instruct, Qwen3.8 Flash-Next NVFP4, Devstral 2, K2 Horizon 7B, K2-Horizon-32B, Devstral Small 2, MiniCPM5-2B, Ling 3.0 Tiny, K2 Horizon 3.7B, K2 Horizon 0.9B, LFM2.5-2.6B.

34 models with no price data — shown in the strip at the left edge

GLM-5.3 Flash NVFP4, DeepSeek V4.1 Flash NVFP4, GLM-5.3 NVFP4, DeepSeek-V4-Pro-0813-nvfp4-DSpark, Xing4.0-29B-A4B, Ternary Bonsai 27B, Atria Dawn Preview, Maple-Preview, Bonsai 27B, Qwen3.8 27B NVFP4, Intern-S2-397B, Phi-4-reasoning-plus, Solar Open2 250B, Laguna S 2.1, Motif 3, Nex-N2-Pro, K-EXAONE 2.0 0803, K2 Horizon 375B A23B, A.X-K2, K2 Horizon MoVA 36B A4B, Intern-S2-Preview (35B-A3B), North Mini Code, G9v3-39A5B, Falcon-H1-34B-Instruct, Qwen3.8 Flash-Next NVFP4, Devstral 2, K2 Horizon 7B, K2-Horizon-32B, Devstral Small 2, MiniCPM5-2B, Ling 3.0 Tiny, K2 Horizon 3.7B, K2 Horizon 0.9B, LFM2.5-2.6B

  • Best-value frontier (nothing is both cheaper and better)
  • Evidencestrong → weak
  • Estimated from other categories
  • Grok 4.7
    Quality
    70.5
    Rank
    #15/119
    Price
    $3.00/M tok
    Speed
    76tok/s
    In$2.00▾Out$6.00▾/M tok

    vs GPT-6 Sol: −5.8 quality · 0.75× price

  • GPT-6 Sol
    Quality
    76.4
    Rank
    #8/119
    Price
    $4.00/M tok
    Speed
    92tok/s
    In$2.00▾Out$10/M tok

    vs Grok 4.7: +5.8 quality · 1.3× price

Overview

Metric
Grok 4.7
GPT-6 Sol
Lab
SpaceXAI (xAI)
OpenAI
Released
Sep 21, 2026
Sep 22, 2026
Weights
Proprietary
Proprietary
Input price
$/M tok
$2.00Best
$2.00Best
Output price
$/M tok
$6.00Best
$10
Blended price
$/M tok · 3:1 in:out
$3.00Best
$4.00
Output speed
tok/s
76
92Best
Context
tokens
500K
872KBest

Quality by category

0–100 within each category (100 = best tracked model). Rank is among all models ranked there. Click a row to focus it.

Metric
Grok 4.7
GPT-6 Sol
Coding
70.5±4.5
#15/119Verified
76.4±4.5Best
#8/119Verified
Writing & chat
68.7±4.3
#30/156Verified
79.3±4.3Best
#9/156Verified
Vision
64.6±4.8
#29/91Verified
86.1±4.8Best
#5/91Verified
Hard reasoning
81.4±5.1
#16/200Verified
85.5±5.1Best
#10/200Verified
Agents
87.1±7.8Best
#3/178Verifiedbest value
75.5±7.8
#19/178Verified

Coding benchmarks

Rank among models with a published score, and the leaderboard around each model. ~ italic = no published score, estimated from related benchmarks.

Metric
Grok 4.7
GPT-6 Sol
SWE-bench Verified
day 0
~#2/14~85.9%Estimated
  1. #1Claude Opus 596.0%
  2. ~#2Grok 4.7Estimated85.9%
  3. #2Claude Sonnet 585.2%
estimated from related benchmarks
~#2/14~89.3%Estimated
  1. #1Claude Opus 596.0%
  2. ~#2GPT-6 SolEstimated89.3%
  3. #2Claude Sonnet 585.2%
estimated from related benchmarks
SWE-bench Pro (Public)
day 0
~#6/20~68.3%Estimated
  1. #1Claude Opus 5.589.9%
  2. #5Intern-S2-397B68.5%
  3. ~#6Grok 4.7Estimated68.3%
  4. #6Hy4 preview65.7%
estimated from related benchmarks
~#5/20~71.8%Estimated
  1. #1Claude Opus 5.589.9%
  2. #4Claude Opus 579.2%
  3. ~#5GPT-6 SolEstimated71.8%
  4. #5Intern-S2-397B68.5%
estimated from related benchmarks
DeepSWE v1.1
day 0
#4/3472.6%BestVerified
  1. #1Gemini 4 Argon78.8%
  2. #3GPT-6.1 Sol73.2%
  3. #4Grok 4.772.6%
  4. #5MiMo-V2.6-Pro71.9%
artificialanalysis.ai · 2026-09-24
#9/3469.0%Verified
  1. #1Gemini 4 Argon78.8%
  2. #8GPT-5.6 Terra69.6%
  3. #9GPT-6 Sol69.0%
  4. #10Claude Opus 5.568.4%
artificialanalysis.ai · 2026-09-24
Terminal-Bench 4.0
day 0
#19/8825.8%Verified
  1. #1Claude Sonnet 5.563.6%
  2. #18DeepSeek V4.1 Flash26.8%
  3. #19Grok 4.725.8%
  4. #20Qwen3.8 Flash-Next25.3%
artificialanalysis.ai · 2026-09-24
#8/8843.9%BestVerified
  1. #1Claude Sonnet 5.563.6%
  2. #7Claude Opus 549.0%
  3. #8GPT-6 Sol43.9%
  4. #9GLM-5.341.9%
artificialanalysis.ai · 2026-09-24
LiveCodeBench
third-party
~#7/25~83.8%Estimated
  1. #1Qwen3.8-Omni-Flash92.6%
  2. #6gpt-oss-120b87.8%
  3. ~#7Grok 4.7Estimated83.8%
  4. #7Ternary Bonsai 27B82.8%
estimated from related benchmarks
~#7/25~85.7%Estimated
  1. #1Qwen3.8-Omni-Flash92.6%
  2. #6gpt-oss-120b87.8%
  3. ~#7GPT-6 SolEstimated85.7%
  4. #7Ternary Bonsai 27B82.8%
estimated from related benchmarks
SciCode
third-party
#14/10557.4%Verified
  1. #1Claude Opus 5.566.9%
  2. #13GPT-6 Sol57.6%
  3. #14Grok 4.757.4%
  4. #15Gemini 3.8 Flash56.6%
artificialanalysis.ai · 2026-09-24
#13/10557.6%BestVerified
  1. #1Claude Opus 5.566.9%
  2. #12GLM-5.3 Flash NVFP457.7%
  3. #13GPT-6 Sol57.6%
  4. #14Grok 4.757.4%
artificialanalysis.ai · 2026-09-24
AA Coding Agent Index
third-party
#8/1756.3Verified
  1. #1Claude Opus 5.566.0
  2. #7GPT-6 Sol56.7
  3. #8Grok 4.756.3
  4. #9Muse Spark 1.354.3
artificialanalysis.ai · 2026-09-24
#7/1756.7BestVerified
  1. #1Claude Opus 5.566.0
  2. #6Claude Opus 559.7
  3. #7GPT-6 Sol56.7
  4. #8Grok 4.756.3
artificialanalysis.ai · 2026-09-24
Benchmarks in other categories (4)

Writing & chat benchmarks

Rank among models with a published score, and the leaderboard around each model. ~ italic = no published score, estimated from related benchmarks.

Metric
Grok 4.7
GPT-6 Sol
IFBench
day 0
~#26/134~72.9%Estimated
  1. #1MiniMax-M382.9%
  2. #25GPT-5.4 mini73.3%
  3. ~#26Grok 4.7Estimated72.9%
  4. #26Gemma 4 26B A4B72.4%
estimated from related benchmarks
~#14/134~78.3%Estimated
  1. #1MiniMax-M382.9%
  2. #13Qwen3.5 397B A17B78.8%
  3. ~#14GPT-6 SolEstimated78.3%
  4. #14Qwen3.7 Plus78.0%
estimated from related benchmarks
MMMLU
day 0
~#2/5~89.6%Estimated
  1. #1Gemini 3.1 Pro92.6%
  2. ~#2Grok 4.7Estimated89.6%
  3. #2Gemma 4 31B88.4%
estimated from related benchmarks
~#2/5~90.2%Estimated
  1. #1Gemini 3.1 Pro92.6%
  2. ~#2GPT-6 SolEstimated90.2%
  3. #2Gemma 4 31B88.4%
estimated from related benchmarks
LMArena Text, Non-English (Elo)
third-party
#29/561435Verified
  1. #1Gemini 4 ArgonFew votes1512
  2. #28GPT-6 Luna1436
  3. #29Grok 4.71435
  4. #30Qwen3.5 397B A17B1434
lmarena.ai · 2026-09-25
#22/561444BestVerified
  1. #1Gemini 4 ArgonFew votes1512
  2. #21Gemini 3.5 Flash-Lite1445
  3. #22GPT-6 Sol1444
  4. #23Qwen3.7 Plus1443
lmarena.ai · 2026-10-02
LMArena Text (Elo)
third-party
#28/561442Verified
  1. #1Gemini 4 Argon1525
  2. #28GPT-6 Luna1442
  3. #28Grok 4.71442
  4. #28Qwen3.5 397B A17B1442
lmarena.ai · 2026-10-02
#20/561457BestVerified
  1. #1Gemini 4 Argon1525
  2. #19Claude Sonnet 51461
  3. #20GPT-6 Sol1457
  4. #21Gemini 3.5 Flash-Lite1456
lmarena.ai · 2026-09-25
EQ-Bench Creative Writing v3 (Elo)
third-party
#8/252007Verified
  1. #1GPT-6 Astra2173
  2. #7Claude Opus 5.52050
  3. #8Grok 4.72007
  4. #9Muse Spark 1.31906
eqbench.com · 2026-09-24
#4/252125BestVerified
  1. #1GPT-6 Astra2173
  2. #3Claude Opus 52133
  3. #4GPT-6 Sol2125
  4. #5Kimi K32082
eqbench.com · 2026-09-24

Vision benchmarks

Rank among models with a published score, and the leaderboard around each model. ~ italic = no published score, estimated from related benchmarks.

Metric
Grok 4.7
GPT-6 Sol
MMMU
day 0
~#2/3~71.3%Estimated
  1. #1Claude Haiku 4.573.2%
  2. ~#2Grok 4.7Estimated71.3%
  3. #2Llama 4 Maverick69.4%
estimated from related benchmarks
~#2/3~71.3%Estimated
  1. #1Claude Haiku 4.573.2%
  2. ~#2GPT-6 SolEstimated71.3%
  3. #2Llama 4 Maverick69.4%
estimated from related benchmarks
MMMU-Pro
day 0
#23/8578.2%Verified
  1. #1Claude Opus 5.587.7%
  2. #22Qwen3.8 Flash-Next NVFP478.3%
  3. #23Grok 4.778.2%
  4. #24Claude Sonnet 577.3%
artificialanalysis.ai · 2026-10-02
#6/8583.3%BestVerified
  1. #1Claude Opus 5.587.7%
  2. #5Claude Opus 584.7%
  3. #6GPT-6 Sol83.3%
  4. #7Qwen3.8 Max (0902)82.8%
artificialanalysis.ai · 2026-09-24
CharXiv Reasoning
day 0
~#5/9~81.2%Estimated
  1. #1Gemini 3.8 Flash86.2%
  2. #4Qwen3.8-Omni-Flash83.5%
  3. ~#5Grok 4.7Estimated81.2%
  4. #5Muse Glimmer78.8%
estimated from related benchmarks
~#2/9~84.9%Estimated
  1. #1Gemini 3.8 Flash86.2%
  2. ~#2GPT-6 SolEstimated84.9%
  3. #2Kimi K384.8%
estimated from related benchmarks
OmniDocBench v1.5
third-party
~#4/8~87.1%Estimated
  1. #1MiniMax-M391.6%
  2. #2Qwen3.8 27B91.1%
  3. ~#4Grok 4.7Estimated87.1%
  4. #4Gemini 3.1 Pro85.3%
estimated from related benchmarks
~#4/8~90.7%Estimated
  1. #1MiniMax-M391.6%
  2. #2Qwen3.8 27B91.1%
  3. ~#4GPT-6 SolEstimated90.7%
  4. #4Gemini 3.1 Pro85.3%
estimated from related benchmarks
GDP.pdf (AA)
third-party
#14/4320.0%Verified
  1. #1GPT-6.1 Sol32.0%
  2. #13GPT-6 Luna20.4%
  3. #14Grok 4.720.0%
  4. #15MiMo-V2.6-Pro19.2%
artificialanalysis.ai · 2026-09-24
#6/4324.8%BestVerified
  1. #1GPT-6.1 Sol32.0%
  2. #4Claude Opus 5.526.2%
  3. #6GPT-6 Sol24.8%
  4. #7GPT-5.6 Terra24.0%
artificialanalysis.ai · 2026-09-24
Chartography
third-party
#19/2314.7%Verified
  1. #1GPT-6 Astra71.0%
  2. #18GLM-5.3 Flash16.3%
  3. #19Grok 4.714.7%
  4. #20DeepSeek V4.1 Flash11.6%
surgehq.ai · 2026-09-24
#3/2353.6%BestVerified
  1. #1GPT-6 Astra71.0%
  2. #2Claude Opus 5.566.3%
  3. #3GPT-6 Sol53.6%
  4. #4Claude Haiku 5.546.4%
surgehq.ai · 2026-09-24

Hard reasoning benchmarks

Rank among models with a published score, and the leaderboard around each model. ~ italic = no published score, estimated from related benchmarks.

Metric
Grok 4.7
GPT-6 Sol
GPQA Diamond
day 0
~#17/184~92.4%Estimated
  1. #1GPT-6 Astra96.1%
  2. #16GPT-5.6 Terra92.5%
  3. ~#17Grok 4.7Estimated92.4%
  4. #17Hy4 preview92.3%
estimated from related benchmarks
~#4/184~93.8%Estimated
  1. #1GPT-6 Astra96.1%
  2. #3Gemini 3.1 Pro94.1%
  3. ~#4GPT-6 SolEstimated93.8%
  4. #4Claude Fable 5.193.7%
estimated from related benchmarks
Humanity's Last Exam
day 0
#19/18443.1%Verified
  1. #1Claude Opus 5.561.4%
  2. #18Hy4 preview43.4%
  3. #19Grok 4.743.1%
  4. #19Qwen3.8 Max (0902)43.1%
artificialanalysis.ai · 2026-09-24
#10/18447.9%BestVerified
  1. #1Claude Opus 5.561.4%
  2. #9Muse Spark 1.348.7%
  3. #10GPT-6 Sol47.9%
  4. #11Gemini 3.8 Flash47.8%
artificialanalysis.ai · 2026-09-24
AIME (latest)
day 0
~#3/32~95.9%Estimated
  1. #1GLM-5.3 NVFP499.5%
  2. #2Inkling97.1%
  3. ~#3Grok 4.7Estimated95.9%
  4. #3Ternary Bonsai 2 27B95.8%
estimated from related benchmarks
~#2/32~98.3%Estimated
  1. #1GLM-5.3 NVFP499.5%
  2. ~#2GPT-6 SolEstimated98.3%
  3. #2Inkling97.1%
estimated from related benchmarks
AA Intelligence Index
third-party
#10/8546.4Verified
  1. #1Claude Opus 5.557.6
  2. #9GPT-6 Sol47.5
  3. #10Grok 4.746.4
  4. #11MiMo-V2.6-Pro46.3
artificialanalysis.ai · 2026-09-24
#9/8547.5BestVerified
  1. #1Claude Opus 5.557.6
  2. #8Muse Spark 1.348.1
  3. #9GPT-6 Sol47.5
  4. #10Grok 4.746.4
artificialanalysis.ai · 2026-09-24

Agents benchmarks

Rank among models with a published score, and the leaderboard around each model. ~ italic = no published score, estimated from related benchmarks.

Metric
Grok 4.7
GPT-6 Sol
τ²-bench (Telecom)
day 0
~#3/118~97.9%Estimated
  1. #1Step 3.7 Flash98.5%
  2. #2DeepSeek-V4-Pro-0813-nvfp4-DSpark98.3%
  3. ~#3Grok 4.7Estimated97.9%
  4. #3Gemini 3.1 Pro95.6%
estimated from related benchmarks
~#3/118~98.2%Estimated
  1. #1Step 3.7 Flash98.5%
  2. #2DeepSeek-V4-Pro-0813-nvfp4-DSpark98.3%
  3. ~#3GPT-6 SolEstimated98.2%
  4. #3Gemini 3.1 Pro95.6%
estimated from related benchmarks
OSWorld-Verified
day 0
~#3/12~82.6%Estimated
  1. #1Kimi K384.8%
  2. #2Qwen3.8 27B84.3%
  3. ~#3Grok 4.7Estimated82.6%
  4. #3Nex-N2.5-Pro82.2%
estimated from related benchmarks
~#3/12~82.7%Estimated
  1. #1Kimi K384.8%
  2. #2Qwen3.8 27B84.3%
  3. ~#3GPT-6 SolEstimated82.7%
  4. #3Nex-N2.5-Pro82.2%
estimated from related benchmarks
OSWorld 2.0
day 0
~#3/5~58.3%Estimated
  1. #1GLM-5.3 Flash59.1%
  2. #2Kimi K358.3%
  3. ~#3Grok 4.7Estimated58.3%
  4. #3GPT-5.6 Terra50.2%
estimated from related benchmarks
~#3/5~54.2%Estimated
  1. #1GLM-5.3 Flash59.1%
  2. #2Kimi K358.3%
  3. ~#3GPT-6 SolEstimated54.2%
  4. #3GPT-5.6 Terra50.2%
estimated from related benchmarks
BrowseComp
day 0
~#6/18~89.0%Estimated
  1. #1Atria Dawn Preview92.5%
  2. #5Nex-N2.5-Pro89.7%
  3. ~#6Grok 4.7Estimated89.0%
  4. #6Step 5 Preview88.7%
estimated from related benchmarks
~#7/18~88.4%Estimated
  1. #1Atria Dawn Preview92.5%
  2. #6Step 5 Preview88.7%
  3. ~#7GPT-6 SolEstimated88.4%
  4. #7GPT-5.6 Terra87.5%
estimated from related benchmarks
GDPval-AA (Elo)
third-party
#4/871715BestVerified
  1. #1Claude Opus 5.51866
  2. #3Claude Opus 51724
  3. #4Grok 4.71715
  4. #5MiMo-V2.6-Pro1686
artificialanalysis.ai · 2026-10-07
#18/871487Verified
  1. #1Claude Opus 5.51866
  2. #17Kimi K31524
  3. #18GPT-6 Sol1487
  4. #19Claude Sonnet 51449
artificialanalysis.ai · 2026-09-24
AutomationBench-AA
third-party
#6/8165.6%BestVerified
  1. #1Claude Opus 5.569.5%
  2. #5GPT-6.1 Sol66.6%
  3. #6Grok 4.765.6%
  4. #7GLM-5.362.2%
artificialanalysis.ai · 2026-09-24
#8/8161.6%Verified
  1. #1Claude Opus 5.569.5%
  2. #7GLM-5.362.2%
  3. #8GPT-6 Sol61.6%
  4. #9GLM-5.3 Flash60.4%
artificialanalysis.ai · 2026-09-24
τ-Bench Banking (AA)
third-party
~#11/90~43.6%Estimated
  1. #1Muse Spark 1.350.5%
  2. #10Gemini 3.8 Flash44.9%
  3. ~#11Grok 4.7Estimated43.6%
  4. #11Grok 4.643.3%
estimated from related benchmarks
~#16/90~39.4%Estimated
  1. #1Muse Spark 1.350.5%
  2. #15DeepSeek V4 Pro (0813)39.6%
  3. ~#16GPT-6 SolEstimated39.4%
  4. #16GPT-5.539.0%
estimated from related benchmarks
Not comparable across labs (1)
OSWorld 2.0 (offline set v2026.08.08)
day 0
—
#3/464.4%Lab-reported
  1. #1GPT-6 Astra72.6%
  2. #2GPT-6.1 Sol71.4%
  3. #3GPT-6 Sol64.4%
  4. #4GPT-6 Luna52.7%
openai.com · 2026-09-22