Cogito v2.1
- Input
- $1.25/M tok
- Output
- $1.25/M tok
- Blended
- $1.25/M tok · 3:1
- Speed
- ~81tok/sest.
- Context
- 128Ktokens
Long-tail import from Artificial Analysis (2026-09-24); AA variant: Cogito v2.1 (Reasoning). Price = AA median host price.
Rankings
Self-hostingEstimated
How we estimate →What it would cost to run these open weights yourself on rented GPUs, compared with the API price above.
- Hardware
- 8× B200 180GB
- FP8 weights
- Throughput
- ~21,907 tok/s
- many requests batched
- Price
- $0.26–2.32 /M tok
- busy → light use
- On your own machine
- Mac Studio M5 Ultra 512GB (int4, ~45 tok/s single-stream)
- single consumer GPU or Mac
Assumptions (5)
- FP8 weights (671B params, 37B active per token) + 25% KV-cache headroom ≈ 839 GB
- 8× B200 180GB at $5.98–$14.24/GPU-hour on-demand (2026-09-24)
- ~21,907 output tok/s aggregate at batch 627 (bandwidth-bound); MoE compute scales with active params
- Blended 3:1 input:output; prefill ~229,865 tok/s
- Low = 75% utilization at the low GPU price; high = 20% at the high price
Benchmark scores
~ italic, dashed = no published score yet, estimated from related benchmarks.
Writing & chat
IFBenchVerified
#77 of 13946.3%
- #1MiniMax-M382.9%
- #2Qwen3.8 2.4T A95B82.8%
- #76Llama 3.3 Instruct 70B47.1%
- #77Cogito v2.146.3%
- #78LFM2 24B A2B45.9%
artificialanalysis.ai · 2026-09-24
MMMLUEstimated
~last of 5 (estimated)below measured range (<81.3%)
No published score — estimated from related benchmarks
LMArena Text, Non-English (Elo)Estimated
~#45 of 57 (estimated)~1350 Elo
- #1Gemini 4 ArgonFew votes1512
- #2Claude Opus 5.51497
- #44GLM-4.6VFew votes1361
- ~#45Cogito v2.1Estimated1350
- #45Trinity Large Thinking1350
No published score — estimated from related benchmarks
LMArena Text (Elo)Estimated
~#45 of 57 (estimated)~1371 Elo
- #1Gemini 4 Argon1525
- #2Claude Opus 5.51507
- #44GLM-4.6VFew votes1378
- ~#45Cogito v2.1Estimated1371
- #45Trinity Large Thinking1369
No published score — estimated from related benchmarks
EQ-Bench Creative Writing v3 (Elo)Estimated
~#20 of 26 (estimated)~1540 Elo
- #1GPT-6 Astra2173
- #2Claude Fable 5.12162
- #19Gemini 3.5 Flash-Lite1559
- ~#20Cogito v2.1Estimated1540
- #20DeepSeek V4.1 Flash1540
No published score — estimated from related benchmarks
Hard reasoning
GPQA DiamondVerified
#86 of 19276.8%
- #1GPT-6 Astra96.1%
- #2Gemini 3.8 Flash95.3%
- #85Mistral Small 476.9%
- #86Cogito v2.176.8%
- #87Command A+76.1%
artificialanalysis.ai · 2026-09-24
Humanity's Last ExamVerified
#98 of 19812.0%
- #1Claude Fable 5.274.3%
- #2Claude Opus 5.561.4%
- #97EXAONE 4.5 33B12.9%
- #98Cogito v2.112.0%
- #98Command A+12.0%
artificialanalysis.ai · 2026-09-24
AIME (latest)Estimated
~#23 of 34 (estimated)~72.8%
- #1GLM-5.3 NVFP499.5%
- #2Beam 1.0 501B A23B97.7%
- #22Phi-4-reasoning-plus78.0%
- ~#23Cogito v2.1Estimated72.8%
- #23Mistral Large 338.0%
No published score — estimated from related benchmarks
AA Intelligence IndexEstimated
~#72 of 103 (estimated)~15.2
- #1Gemini 4 Carbon59.4
- #2Claude Opus 5.557.6
- #70Qwen3.5 122B A10B15.6
- ~#72Cogito v2.1Estimated15.2
- #72Gemma 4 31B14.7
No published score — estimated from related benchmarks