Skip to content
Model Pareto

GPT-6 Sol vs Kimi K3

GPT-6 Sol scores higher in coding, vision and hard reasoning; Kimi K3 in writing & chat and agents. Kimi K3 costs 1.5× as much as GPT-6 Sol ($6.00 vs $4.00 per million tokens, blended 3:1 input:output).
GPT-6 SolKimi K3
Focus

Coding: quality vs price

Compared models are ringed; the other 101 ranked here are greyed.

Lower price is better. Pareto frontier: Granite 4.2 3B, NVIDIA Nemotron 3 Nano 30B A3B, gpt-oss-20b, Ling-3.0-flash-VL, MiMo-V2.6-Flash, GLM-5.3 Flash, DeepSeek V4.1 Flash, MiMo-V2.6-Pro, Claude Sonnet 5.5, Claude Opus 5.5. 26 models are not plotted: Xing4.0-29B-A4B, Nex-N2.5-Pro, Atria Dawn Preview, Intern-S2-397B, Solar Open2 250B, Phi-4-reasoning-plus, Motif 3, Nex-N2-Pro, Nex-N2.5-Mini, A.X-K2, K2 Horizon 375B A23B, K-EXAONE 2.0 0803, K2 Horizon MoVA 36B A4B, Intern-S2-Preview (35B-A3B), Command A+, North Mini Code, G9v3-39A5B, Falcon-H1-34B-Instruct, Devstral 2, K2 Horizon 7B, Devstral Small 2, MiniCPM5-2B, Ling 3.0 Tiny, K2 Horizon 3.7B, K2 Horizon 0.9B, LFM2.5-2.6B.

26 models with no price data — shown in the strip at the left edge

Xing4.0-29B-A4B, Nex-N2.5-Pro, Atria Dawn Preview, Intern-S2-397B, Solar Open2 250B, Phi-4-reasoning-plus, Motif 3, Nex-N2-Pro, Nex-N2.5-Mini, A.X-K2, K2 Horizon 375B A23B, K-EXAONE 2.0 0803, K2 Horizon MoVA 36B A4B, Intern-S2-Preview (35B-A3B), Command A+, North Mini Code, G9v3-39A5B, Falcon-H1-34B-Instruct, Devstral 2, K2 Horizon 7B, Devstral Small 2, MiniCPM5-2B, Ling 3.0 Tiny, K2 Horizon 3.7B, K2 Horizon 0.9B, LFM2.5-2.6B

  • Best-value frontier (nothing is both cheaper and better)
  • Evidencestrong → weak
  • Estimated from other categories
  • GPT-6 Sol
    Quality
    78.7
    Rank
    #6/103
    Price
    $4.00/M tok
    Speed
    110tok/s
    In$2.00▾Out$10▾/M tok

    vs Kimi K3: +13.5 quality · 0.67× price

  • Kimi K3
    Quality
    65.2
    Rank
    #16/103
    Price
    $6.00/M tok
    Speed
    37tok/s
    In$3.00Out$15/M tok

    vs GPT-6 Sol: −13.5 quality · 1.5× price

Overview

Metric
GPT-6 Sol
Kimi K3
Lab
OpenAI
Moonshot AI (Kimi)
Released
Sep 22, 2026
Jul 16, 2026
Weights
Proprietary
Open
Input price
$/M tok
$2.00Best
$3.00
Output price
$/M tok
$10Best
$15
Blended price
$/M tok · 3:1 in:out
$4.00Best
$6.00
Output speed
tok/s
110Best
37
Context
tokens
872K
1MBest

Quality by category

0–100 within each category (100 = best tracked model). Rank is among all models ranked there. Click a row to focus it.

Metric
GPT-6 Sol
Kimi K3
Coding
78.7±4.5Best
#6/103Verified
65.2±4.5
#16/103Verified
Writing & chat
83.1±4.3
#7/146Verified
89.1±4.3Best
#5/146Verifiedbest value
Vision
86.8±4.8Best
#4/82Verifiedbest value
77.0±3.9
#11/82Mixed
Hard reasoning
85.8±5.1Best
#8/182Verified
83.4±3.7
#9/182Verified
Agents
76.0±7.8
#17/173Verified
82.4±3.5Best
#12/173Mixed

Coding benchmarks

Rank among models with a published score, and the leaderboard around each model. ~ italic = no published score, estimated from related benchmarks.

Metric
GPT-6 Sol
Kimi K3
SWE-bench Verified
day 0
~#2/14~89.3%Estimated
  1. #1Claude Opus 596.0%
  2. ~#2GPT-6 SolEstimated89.3%
  3. #2Claude Sonnet 585.2%
estimated from related benchmarks
~#2/14~85.3%Estimated
  1. #1Claude Opus 596.0%
  2. ~#2Kimi K3Estimated85.3%
  3. #2Claude Sonnet 585.2%
estimated from related benchmarks
SWE-bench Pro (Public)
day 0
~#5/19~71.9%Estimated
  1. #1Claude Opus 5.589.9%
  2. #4Claude Opus 579.2%
  3. ~#5GPT-6 SolEstimated71.9%
  4. #5Intern-S2-397B68.5%
estimated from related benchmarks
~#6/19~66.6%Estimated
  1. #1Claude Opus 5.589.9%
  2. #5Intern-S2-397B68.5%
  3. ~#6Kimi K3Estimated66.6%
  4. #6Hy4 preview65.7%
estimated from related benchmarks
DeepSWE v1.1
day 0
#7/3069.0%BestVerified
  1. #1DeepSeek V4.1 Flash74.2%
  2. #6GPT-5.6 Terra69.6%
  3. #7GPT-6 Sol69.0%
  4. #8Claude Opus 5.568.4%
artificialanalysis.ai · 2026-09-24
#8/3068.4%Verified
  1. #1DeepSeek V4.1 Flash74.2%
  2. #8Claude Opus 5.568.4%
  3. #8Kimi K368.4%
  4. #10MiMo-V2.6-Flash67.9%
artificialanalysis.ai · 2026-09-24
Terminal-Bench 4.0
day 0
#6/8343.9%BestVerified
  1. #1Claude Sonnet 5.563.6%
  2. #5Claude Opus 549.0%
  3. #6GPT-6 Sol43.9%
  4. #7GLM-5.341.9%
artificialanalysis.ai · 2026-09-24
#23/8312.6%Verified
  1. #1Claude Sonnet 5.563.6%
  2. #23GPT-6 Luna12.6%
  3. #23Kimi K312.6%
  4. #26Qwen3.8 2.4T A95B11.1%
artificialanalysis.ai · 2026-09-24
LiveCodeBench
third-party
~#2/20~92.1%Estimated
  1. #1Qwen3.8-Omni-Flash92.6%
  2. ~#2GPT-6 SolEstimated92.1%
  3. #2Qwen3.8 Flash-Next91.9%
estimated from related benchmarks
~#3/20~90.7%Estimated
  1. #1Qwen3.8-Omni-Flash92.6%
  2. #2Qwen3.8 Flash-Next91.9%
  3. ~#3Kimi K3Estimated90.7%
  4. #3Qwen3.8 27B90.3%
estimated from related benchmarks
SciCode
third-party
#10/9557.6%Verified
  1. #1Claude Opus 5.566.9%
  2. #9Gemini 3.1 Pro58.7%
  3. #10GPT-6 Sol57.6%
  4. #11Grok 4.757.4%
artificialanalysis.ai · 2026-09-24
#5/9559.5%BestVerified
  1. #1Claude Opus 5.566.9%
  2. #4MiMo-V2.6-Pro60.9%
  3. #5Kimi K359.5%
  4. #6GLM-5.359.0%
artificialanalysis.ai · 2026-09-24
AA Coding Agent Index
third-party
#5/1456.7BestVerified
  1. #1Claude Opus 5.566.0
  2. #4Claude Opus 559.7
  3. #5GPT-6 Sol56.7
  4. #6Grok 4.756.3
artificialanalysis.ai · 2026-09-24
#9/1451.9Verified
  1. #1Claude Opus 5.566.0
  2. #8GLM-5.353.6
  3. #9Kimi K351.9
  4. #10Grok 4.647.0
artificialanalysis.ai · 2026-09-24
Benchmarks in other categories (4)

Writing & chat benchmarks

Rank among models with a published score, and the leaderboard around each model. ~ italic = no published score, estimated from related benchmarks.

Metric
GPT-6 Sol
Kimi K3
IFBench
day 0
~#7/126~80.7%Estimated
  1. #1MiniMax-M382.9%
  2. #6Intern-S2-Preview (35B-A3B)80.9%
  3. ~#7GPT-6 SolEstimated80.7%
  4. #7Nemotron Cascade 2 30B A3B80.4%
estimated from related benchmarks
~#3/126~82.6%Estimated
  1. #1MiniMax-M382.9%
  2. #2Qwen3.8 2.4T A95B82.8%
  3. ~#3Kimi K3Estimated82.6%
  4. #3Qwen3.8-Omni-Flash81.5%
estimated from related benchmarks
MMMLU
day 0
~#2/5~90.4%Estimated
  1. #1Gemini 3.1 Pro92.6%
  2. ~#2GPT-6 SolEstimated90.4%
  3. #2Gemma 4 31B88.4%
estimated from related benchmarks
~#2/5~92.0%Estimated
  1. #1Gemini 3.1 Pro92.6%
  2. ~#2Kimi K3Estimated92.0%
  3. #2Gemma 4 31B88.4%
estimated from related benchmarks
LMArena Text, Non-English (Elo)
third-party
#16/531448Verified
  1. #1Claude Opus 5.51501
  2. #16DeepSeek V4 Pro (0813)1448
  3. #16GPT-6 Sol1448
  4. #18Claude Sonnet 51447
lmarena.ai · 2026-09-25
#7/531477BestVerified
  1. #1Claude Opus 5.51501
  2. #6Gemini 3.1 Pro1480
  3. #7Kimi K31477
  4. #8GPT-5.51474
lmarena.ai · 2026-09-25
LMArena Text (Elo)
third-party
#18/531457Verified
  1. #1Claude Opus 5.51509
  2. #17Claude Sonnet 51461
  3. #18GPT-6 Sol1457
  4. #19Gemini 3.5 Flash-Lite1456
lmarena.ai · 2026-09-25
#6/531488BestVerified
  1. #1Claude Opus 5.51509
  2. #3Muse Spark 1.31493
  3. #6Kimi K31488
  4. #7Gemini 3.1 Pro1487
lmarena.ai · 2026-09-25
EQ-Bench Creative Writing v3 (Elo)
third-party
#4/252125BestVerified
  1. #1GPT-6 Astra2173
  2. #3Claude Opus 52133
  3. #4GPT-6 Sol2125
  4. #5Kimi K32082
eqbench.com · 2026-09-24
#5/252082Verified
  1. #1GPT-6 Astra2173
  2. #4GPT-6 Sol2125
  3. #5Kimi K32082
  4. #6GLM-5.32075
eqbench.com · 2026-09-24

Vision benchmarks

Rank among models with a published score, and the leaderboard around each model. ~ italic = no published score, estimated from related benchmarks.

Metric
GPT-6 Sol
Kimi K3
MMMU
day 0
~#2/3~71.3%Estimated
  1. #1Claude Haiku 4.573.2%
  2. ~#2GPT-6 SolEstimated71.3%
  3. #2Llama 4 Maverick69.4%
estimated from related benchmarks
~#2/3~71.3%Estimated
  1. #1Claude Haiku 4.573.2%
  2. ~#2Kimi K3Estimated71.3%
  3. #2Llama 4 Maverick69.4%
estimated from related benchmarks
MMMU-Pro
day 0
#5/7683.3%BestVerified
  1. #1Claude Opus 5.587.7%
  2. #4Claude Opus 584.7%
  3. #5GPT-6 Sol83.3%
  4. #6Qwen3.8 Max (0902)82.8%
artificialanalysis.ai · 2026-09-24
#11/7680.5%Verified
  1. #1Claude Opus 5.587.7%
  2. #10GPT-5.6 Terra80.7%
  3. #11Kimi K380.5%
  4. #11Qwen3.7 Plus80.5%
artificialanalysis.ai · 2026-09-24
CharXiv Reasoning
day 0
~#2/9~85.0%Estimated
  1. #1Gemini 3.8 Flash86.2%
  2. ~#2GPT-6 SolEstimated85.0%
  3. #2Kimi K384.8%
estimated from related benchmarks
#2/884.8%Lab-reported
  1. #1Gemini 3.8 Flash86.2%
  2. #2Kimi K384.8%
  3. #3Qwen3.8 Flash-Next84.6%
huggingface.co · 2026-07-16
OmniDocBench v1.5
third-party
~#4/8~90.8%Estimated
  1. #1MiniMax-M391.6%
  2. #2Qwen3.8 27B91.1%
  3. ~#4GPT-6 SolEstimated90.8%
  4. #4Gemini 3.1 Pro85.3%
estimated from related benchmarks
#2/791.1%Lab-reported
  1. #1MiniMax-M391.6%
  2. #2Kimi K391.1%
  3. #2Qwen3.8 27B91.1%
huggingface.co · 2026-07-16
GDP.pdf (AA)
third-party
#5/4224.8%BestVerified
  1. #1GPT-6 Astra31.0%
  2. #3Claude Opus 5.526.2%
  3. #5GPT-6 Sol24.8%
  4. #6GPT-5.6 Terra24.0%
artificialanalysis.ai · 2026-09-24
#8/4222.0%Verified
  1. #1GPT-6 Astra31.0%
  2. #7Qwen3.8 Max (0902)22.8%
  3. #8Kimi K322.0%
  4. #9Claude Opus 521.6%
artificialanalysis.ai · 2026-09-24
Chartography
third-party
#3/2253.6%BestVerified
  1. #1GPT-6 Astra71.0%
  2. #2Claude Opus 5.566.3%
  3. #3GPT-6 Sol53.6%
  4. #4Claude Fable 5.146.2%
surgehq.ai · 2026-09-24
#12/2226.6%Verified
  1. #1GPT-6 Astra71.0%
  2. #11Claude Opus 527.3%
  3. #12Kimi K326.6%
  4. #13Gemini 3.1 Pro26.1%
surgehq.ai · 2026-09-24

Hard reasoning benchmarks

Rank among models with a published score, and the leaderboard around each model. ~ italic = no published score, estimated from related benchmarks.

Metric
GPT-6 Sol
Kimi K3
GPQA Diamond
day 0
~#3/173~94.7%Estimated
  1. #1GPT-6 Astra96.1%
  2. #2Gemini 3.8 Flash95.3%
  3. ~#3GPT-6 SolEstimated94.7%
  4. #3Gemini 3.1 Pro94.1%
estimated from related benchmarks
#5/17293.5%Verified
  1. #1GPT-6 Astra96.1%
  2. #5Grok 4.693.5%
  3. #5Kimi K393.5%
  4. #5Muse Spark 1.393.5%
artificialanalysis.ai · 2026-09-24
Humanity's Last Exam
day 0
#8/17847.9%BestVerified
  1. #1Claude Opus 5.561.4%
  2. #7Muse Spark 1.348.7%
  3. #8GPT-6 Sol47.9%
  4. #9Gemini 3.8 Flash47.8%
artificialanalysis.ai · 2026-09-24
#11/17846.9%Verified
  1. #1Claude Opus 5.561.4%
  2. #10Gemini 3.1 Pro47.0%
  3. #11Kimi K346.9%
  4. #12Step 5 Preview46.5%
artificialanalysis.ai · 2026-09-24
AIME (latest)
day 0
~#2/25~96.5%Estimated
  1. #1Inkling97.1%
  2. ~#2GPT-6 SolEstimated96.5%
  3. #2Muse Glimmer94.7%
estimated from related benchmarks
~#2/25~96.8%Estimated
  1. #1Inkling97.1%
  2. ~#2Kimi K3Estimated96.8%
  3. #2Muse Glimmer94.7%
estimated from related benchmarks
AA Intelligence Index
third-party
#7/7447.5BestVerified
  1. #1Claude Opus 5.557.6
  2. #6Muse Spark 1.348.1
  3. #7GPT-6 Sol47.5
  4. #8Grok 4.746.4
artificialanalysis.ai · 2026-09-24
#14/7443.6Verified
  1. #1Claude Opus 5.557.6
  2. #13Step 5 Preview43.7
  3. #14Kimi K343.6
  4. #15GPT-5.6 Terra42.1
artificialanalysis.ai · 2026-09-24

Agents benchmarks

Rank among models with a published score, and the leaderboard around each model. ~ italic = no published score, estimated from related benchmarks.

Metric
GPT-6 Sol
Kimi K3
τ²-bench (Telecom)
day 0
~#2/116~98.2%Estimated
  1. #1Step 3.7 Flash98.5%
  2. ~#2GPT-6 SolEstimated98.2%
  3. #2Gemini 3.1 Pro95.6%
estimated from related benchmarks
~#2/116~98.3%Estimated
  1. #1Step 3.7 Flash98.5%
  2. ~#2Kimi K3Estimated98.3%
  3. #2Gemini 3.1 Pro95.6%
estimated from related benchmarks
OSWorld-Verified
day 0
~#3/12~82.8%Estimated
  1. #1Kimi K384.8%
  2. #2Qwen3.8 27B84.3%
  3. ~#3GPT-6 SolEstimated82.8%
  4. #3Nex-N2.5-Pro82.2%
estimated from related benchmarks
#1/1184.8%Lab-reported
  1. #1Kimi K384.8%
  2. #2Qwen3.8 27B84.3%
huggingface.co · 2026-07-16
OSWorld 2.0
day 0
~#3/5~54.2%Estimated
  1. #1GLM-5.3 Flash59.1%
  2. #2Kimi K358.3%
  3. ~#3GPT-6 SolEstimated54.2%
  4. #3GPT-5.6 Terra50.2%
estimated from related benchmarks
#2/458.3%Lab-reported
  1. #1GLM-5.3 Flash59.1%
  2. #2Kimi K358.3%
  3. #3GPT-5.6 Terra50.2%
huggingface.co · 2026-07-16
BrowseComp
day 0
~#7/18~88.6%Estimated
  1. #1Atria Dawn Preview92.5%
  2. #6Step 5 Preview88.7%
  3. ~#7GPT-6 SolEstimated88.6%
  4. #7GPT-5.6 Terra87.5%
estimated from related benchmarks
#3/1791.2%Lab-reported
  1. #1Atria Dawn Preview92.5%
  2. #2GPT-6 Astra91.5%
  3. #3Kimi K391.2%
  4. #4Claude Opus 590.8%
huggingface.co · 2026-07-16
GDPval-AA (Elo)
third-party
#17/861487Verified
  1. #1Claude Opus 5.51846
  2. #16Kimi K31524
  3. #17GPT-6 Sol1487
  4. #18Claude Sonnet 51449
artificialanalysis.ai · 2026-09-24
#16/861524BestVerified
  1. #1Claude Opus 5.51846
  2. #15GPT-6 Astra1542
  3. #16Kimi K31524
  4. #17GPT-6 Sol1487
artificialanalysis.ai · 2026-09-24
AutomationBench-AA
third-party
#7/7961.6%BestVerified
  1. #1Claude Opus 5.569.5%
  2. #6GLM-5.362.2%
  3. #7GPT-6 Sol61.6%
  4. #8GLM-5.3 Flash60.4%
artificialanalysis.ai · 2026-09-24
#13/7958.3%Verified
  1. #1Claude Opus 5.569.5%
  2. #12MiMo-V2.6-Pro58.6%
  3. #13Kimi K358.3%
  4. #14Muse Spark 1.357.9%
artificialanalysis.ai · 2026-09-24
τ-Bench Banking (AA)
third-party
~#16/89~39.5%Estimated
  1. #1Muse Spark 1.350.5%
  2. #15DeepSeek V4 Pro (0813)39.6%
  3. ~#16GPT-6 SolEstimated39.5%
  4. #16GPT-5.539.0%
estimated from related benchmarks
#8/8846.0%Verified
  1. #1Muse Spark 1.350.5%
  2. #6GLM-5.3 Flash47.2%
  3. #8Kimi K346.0%
  4. #9Qwen3.8 Flash-Next45.4%
artificialanalysis.ai · 2026-09-24
Not comparable across labs (1)
OSWorld 2.0 (offline set v2026.08.08)
day 0
#2/364.4%Lab-reported
  1. #1GPT-6 Astra72.6%
  2. #2GPT-6 Sol64.4%
  3. #3GPT-6 Luna52.7%
openai.com · 2026-09-22
—