Llama 3.2 Instruct 90B (Vision)
- Input
- —
- Output
- —
- Speed
- ~53tok/sest.
- Context
- 128Ktokens
Long-tail import from Artificial Analysis (2026-09-24); AA variant: Llama 3.2 Instruct 90B (Vision). Price = AA median host price.
Rankings
Self-hostingEstimated
How we estimate →What it would cost to run these open weights yourself on rented GPUs. No API sells this model, so this is its price on the chart.
- Hardware
- 1× B200 180GB
- FP8 weights
- Throughput
- ~1,651 tok/s
- many requests batched
- Price
- $0.47–4.23 /M tok
- busy → light use
- On your own machine
- Mac Studio M5 Max 128GB (int4, ~10 tok/s single-stream)
- single consumer GPU or Mac
Assumptions (5)
- FP8 weights (88.6B params) + 25% KV-cache headroom ≈ 111 GB
- 1× B200 180GB at $5.98–$14.24/GPU-hour on-demand (2026-09-24)
- ~1,651 output tok/s aggregate at batch 47 (bandwidth-bound)
- Blended 3:1 input:output; prefill ~11,999 tok/s
- Low = 75% utilization at the low GPU price; high = 20% at the high price
Benchmark scores
~ italic, dashed = no published score yet, estimated from related benchmarks.
Vision
MMMU-ProVerified
#79 of 8739.5%
- #1Claude Opus 5.587.7%
- #2GPT-6 Astra86.9%
- #78Gemma 4 E2B41.8%
- #79Llama 3.2 Instruct 90B (Vision)39.5%
- #80Ministral 3 3B38.1%
artificialanalysis.ai · 2026-09-24
CharXiv ReasoningEstimated
~last of 12 (estimated)below measured range (<74.5%)
- #1Gemini 3.8 Flash86.2%
- #2Kimi K384.8%
- #11Gemini 3.5 Flash-Lite74.5%
- ~#12Llama 3.2 Instruct 90B (Vision)Estimated<74.5%
No published score — estimated from related benchmarks
OmniDocBench v1.5Estimated
~last of 8 (estimated)below measured range (<75.8%)
No published score — estimated from related benchmarks
GDP.pdf (AA)Estimated
~#46 of 48 (estimated)~0.2%
- #1Muse Wonder Full32.6%
- #2GPT-6 Astra31.0%
- #45Ministral 3 8B0.8%
- ~#46Llama 3.2 Instruct 90B (Vision)Estimated0.2%
- #46Ministral 3 3B0.0%
No published score — estimated from related benchmarks
ChartographyEstimated
~last of 25 (estimated)below measured range (<9.0%)
- #1Claude Fable 5.273.4%
- #2GPT-6 Astra71.0%
- #24Mistral Large 39.0%
- ~#25Llama 3.2 Instruct 90B (Vision)Estimated<9.0%
No published score — estimated from related benchmarks
Hard reasoning
GPQA DiamondVerified
#163 of 19243.2%
- #1GPT-6 Astra96.1%
- #2Gemini 3.8 Flash95.3%
- #162Qwen3.5 2B43.8%
- #163Llama 3.2 Instruct 90B (Vision)43.2%
- #164Molmo2-8B42.5%
artificialanalysis.ai · 2026-09-24
Humanity's Last ExamVerified
#178 of 1984.5%
- #1Claude Fable 5.274.3%
- #2Claude Opus 5.561.4%
- #174Qwen3 Omni 30B A3B Instruct4.6%
- #178Llama 3.2 Instruct 90B (Vision)4.5%
- #179Jamba 1.7 Mini4.4%
artificialanalysis.ai · 2026-09-24
AIME (latest)Estimated
~#29 of 34 (estimated)~27.6%
- #1GLM-5.3 NVFP499.5%
- #2Beam 1.0 501B A23B97.7%
- #28Ministral 3 14B30.0%
- ~#29Llama 3.2 Instruct 90B (Vision)Estimated27.6%
- #29Ministral 3 3B22.0%
No published score — estimated from related benchmarks
AA Intelligence IndexEstimated
~#102 of 103 (estimated)~4.6
- #1Gemini 4 Carbon59.4
- #2Claude Opus 5.557.6
- #100NVIDIA Nemotron 3 Nano 4B4.8
- ~#102Llama 3.2 Instruct 90B (Vision)Estimated4.6
- #102K2 Horizon 0.9B3.0
No published score — estimated from related benchmarks