Nemotron 3.5 Lightning
- Input
- $0.06/M tok
- Output
- $0.20/M tok
- Blended
- $0.095/M tok · 3:1
- Speed
- 267tok/s
- Context
- 1Mtokens
- Cost per task
- ~$0.08/taskest.
Long-tail import from Artificial Analysis (2026-09-24); AA variant: Nemotron 3.5 Lightning. Price = AA median host price.
Rankings
Self-hostingEstimated
How we estimate →What it would cost to run these open weights yourself on rented GPUs, compared with the API price above.
- Hardware
- 1× H200 141GB
- FP8 weights
- Throughput
- ~8,799 tok/s
- many requests batched
- Price
- $0.044–0.37 /M tok
- busy → light use
- On your own machine
- RTX 5090 32GB (int4, 300+ tok/s single-stream)
- single consumer GPU or Mac
Assumptions (5)
- FP8 weights (30B params, 3B active per token) + 40% KV-cache headroom ≈ 42 GB
- 1× H200 141GB at $3.59–$7.91/GPU-hour on-demand (2026-09-24)
- ~8,799 output tok/s aggregate at batch 256 (bandwidth-bound); MoE compute scales with active params
- Blended 3:1 input:output; prefill ~155,846 tok/s
- Low = 75% utilization at the low GPU price; high = 20% at the high price
Benchmark scores
~ italic, dashed = no published score yet, estimated from related benchmarks.
Coding
SWE-bench VerifiedEstimated
~#17 of 21 (estimated)~65.7%
- #1Claude Opus 596.0%
- #2Claude Sonnet 585.2%
- #16Nemotron 3 Ultra70.7%
- ~#17Nemotron 3.5 LightningEstimated65.7%
- #17Intern-S2-Preview (35B-A3B)64.0%
No published score — estimated from related benchmarks
SWE-bench Pro (Public)Estimated
~#23 of 24 (estimated)~45.6%
- #1Claude Fable 5.293.0%
- #2Claude Opus 5.589.9%
- #22Muse Glimmer51.2%
- ~#23Nemotron 3.5 LightningEstimated45.6%
- #23Nex-N2.5-Mini43.8%
No published score — estimated from related benchmarks
DeepSWE v1.1Estimated
~#42 of 46 (estimated)~37.6%
- #1Gemini 4 Argon78.8%
- #2DeepSeek V4.1 Flash 101777.0%
- #41Laguna S 2.140.4%
- ~#42Nemotron 3.5 LightningEstimated37.6%
- #42Nex-N2.5-Mini36.1%
No published score — estimated from related benchmarks
Terminal-Bench 4.0Verified
#53 of 1010.5%
- #1Kimi K3.1 Pro67.2%
- #2Claude Sonnet 5.563.6%
- #53Nemotron 3 Ultra0.5%
- #53Nemotron 3.5 Lightning0.5%
- #53North Mini Code0.5%
artificialanalysis.ai · 2026-09-24
LiveCodeBenchEstimated
~#19 of 28 (estimated)~52.0%
- #1Qwen3.8-Omni-Flash92.6%
- #2Qwen3.8 Flash-Next91.9%
- #18Phi-4-reasoning-plus53.1%
- ~#19Nemotron 3.5 LightningEstimated52.0%
- #19Falcon-H1-34B-Instruct49.7%
No published score — estimated from related benchmarks
SciCodeVerified
#101 of 11832.1%
- #1Claude Fable 5.267.7%
- #2Claude Opus 5.566.9%
- #100Devstral Small 232.4%
- #101Nemotron 3.5 Lightning32.1%
- #102Llama 4 Maverick31.7%
artificialanalysis.ai · 2026-09-24
AA Coding Agent IndexEstimated
~#25 of 26 (estimated)~28.0
- #1Claude Opus 5.561.7
- #2Claude Opus 559.7
- #24GPT-6 Luna31.1
- ~#25Nemotron 3.5 LightningEstimated28.0
- #25Muse Spark Open26.3
No published score — estimated from related benchmarks
Hard reasoning
GPQA DiamondVerified
#98 of 19274.3%
- #1GPT-6 Astra96.1%
- #2Gemini 3.8 Flash95.3%
- #97LFM2.5-24B-A2B74.4%
- #98Nemotron 3.5 Lightning74.3%
- #99Qwen3 Next 80B A3B Instruct73.8%
artificialanalysis.ai · 2026-09-24
Humanity's Last ExamVerified
#115 of 19810.6%
- #1Claude Fable 5.274.3%
- #2Claude Opus 5.561.4%
- #112Step3 VL 10B10.8%
- #115Nemotron 3.5 Lightning10.6%
- #116K2-V210.5%
artificialanalysis.ai · 2026-09-24
AIME (latest)Estimated
~#23 of 34 (estimated)~65.1%
- #1GLM-5.3 NVFP499.5%
- #2Beam 1.0 501B A23B97.7%
- #22Phi-4-reasoning-plus78.0%
- ~#23Nemotron 3.5 LightningEstimated65.1%
- #23Mistral Large 338.0%
No published score — estimated from related benchmarks
Agents
τ²-bench (Telecom)Estimated
~#53 of 120 (estimated)~45.5%
- #1Step 3.7 Flash98.5%
- #2DeepSeek-V4-Pro-0813-nvfp4-DSpark98.3%
- #52Sarvam 105B46.8%
- ~#53Nemotron 3.5 LightningEstimated45.5%
- #53Nemotron 3 Nano Omni 30B A3B Reasoning45.3%
No published score — estimated from related benchmarks
OSWorld-VerifiedEstimated
~#12 of 15 (estimated)~59.7%
- #1Kimi K384.8%
- #2Qwen3.8 27B84.3%
- #11Muse Glimmer65.9%
- ~#12Nemotron 3.5 LightningEstimated59.7%
- #12Nemotron 3.5 Super VL NVFP452.3%
No published score — estimated from related benchmarks
OSWorld 2.0Estimated
~last of 5 (estimated)below measured range (<47.5%)
No published score — estimated from related benchmarks
BrowseCompEstimated
~#19 of 22 (estimated)~55.1%
- #1Atria Dawn Preview92.5%
- #2GPT-6 Astra91.5%
- #18Nemotron 3.5 Bolt 74B-A9B70.0%
- ~#19Nemotron 3.5 LightningEstimated55.1%
- #19Mistral Medium 3.548.6%
No published score — estimated from related benchmarks
GDPval-AA (Elo)Verified
#61 of 91624 Elo
- #1Claude Opus 5.51866
- #2Muse Wonder Full1857
- #60MiniCPM5-2B694
- #61Nemotron 3.5 Lightning624
- #62Gemma 4 31B606
artificialanalysis.ai · 2026-09-24