Skip to content
Model Pareto

Inkling

Thinking Machines LabOpen weightsthinkingmachines.ai ↗
Input
$1.00/M tok
Output
$4.05/M tok
Blended
$1.762/M tok · 3:1
Speed
184tok/s
Context
1Mtokens

Open weights; no first-party per-token API, price is the Artificial Analysis third-party host price.

Rankings

Self-hostingEstimated

How we estimate →

What it would cost to run these open weights yourself on rented GPUs, compared with the API price above.

Hardware
16× B200 180GB
FP8 weights
Throughput
~45,766 tok/s
many requests batched
Price
$0.27–2.40 /M tok
busy → light use
On your own machine
Too large
needs data-center GPUs
Assumptions (5)
  • FP8 weights (975B params, 41B active per token) + 40% KV-cache headroom ≈ 1365 GB
  • 16× B200 180GB at $5.98–$14.24/GPU-hour on-demand (2026-09-24)
  • ~45,766 output tok/s aggregate at batch 1541 (bandwidth-bound); MoE compute scales with active params
  • Blended 3:1 input:output; prefill ~352,646 tok/s
  • Low = 75% utilization at the low GPU price; high = 20% at the high price

Benchmark scores

~ italic, dashed = no published score yet, estimated from related benchmarks.

Coding

Writing & chat

Vision

Hard reasoning

Agents