Skip to content
Model Pareto

gpt-oss-120b

OpenAIOpen weightsopenai.com ↗
Input
$0.15/M tok
Output
$0.595/M tok
Blended
$0.261/M tok · 3:1
Speed
186tok/s
Context
131Ktokens

Open weights; price is the median third-party host price (Artificial Analysis). Weights ship in MXFP4 (card: "post-trained with MXFP4 quantization of the MoE weights, making gpt-oss-120b run on a single 80GB GPU").

Rankings

Self-hostingEstimated

How we estimate →

What it would cost to run these open weights yourself on rented GPUs, compared with the API price above.

Hardware
2× H200 141GB
FP8 weights
Throughput
~10,270 tok/s
many requests batched
Price
$0.076–0.62 /M tok
busy → light use
On your own machine
Mac Studio M5 Max 128GB (int4, ~170 tok/s single-stream)
single consumer GPU or Mac
Assumptions (5)
  • FP8 weights (117B params, 5.1B active per token) + 25% KV-cache headroom ≈ 146 GB
  • 2× H200 141GB at $3.59–$7.91/GPU-hour on-demand (2026-09-24)
  • ~10,270 output tok/s aggregate at batch 369 (bandwidth-bound); MoE compute scales with active params
  • Blended 3:1 input:output; prefill ~183,349 tok/s
  • Low = 75% utilization at the low GPU price; high = 20% at the high price

Benchmark scores

~ italic, dashed = no published score yet, estimated from related benchmarks.

Coding

Writing & chat

Hard reasoning

Agents