LFM2.5-24B-A2B
- Input
- —
- Output
- —
- Speed
- ~110tok/sest.
- Context
- 131Ktokens
Rankings
Self-hostingEstimated
How we estimate →What it would cost to run these open weights yourself on rented GPUs. No API sells this model, so this is its price on the chart.
- Hardware
- 1× H200 141GB
- BF16 weights
- Throughput
- ~7,947 tok/s
- many requests batched
- Price
- $0.052–0.43 /M tok
- busy → light use
- On your own machine
- RTX 5090 32GB (int4, 300+ tok/s single-stream)
- single consumer GPU or Mac
Assumptions (5)
- BF16 weights (24B params, 2.45B active per token) + 25% KV-cache headroom ≈ 60 GB
- 1× H200 141GB at $3.59–$7.91/GPU-hour on-demand (2026-09-24)
- ~7,947 output tok/s aggregate at batch 256 (bandwidth-bound); MoE compute scales with active params
- Blended 3:1 input:output; prefill ~95,368 tok/s
- Low = 75% utilization at the low GPU price; high = 20% at the high price
Benchmark scores
~ italic, dashed = no published score yet, estimated from related benchmarks.
Coding
SWE-bench VerifiedLab-reported
#19 of 1951.0%
- #1Claude Opus 596.0%
- #2Claude Sonnet 585.2%
- #18NVIDIA Nemotron-Labs Dory1.0 4B59.5%
- #19LFM2.5-24B-A2B51.0%
huggingface.co · 2026-10-15
SWE-bench Pro (Public)Estimated
~last of 23 (estimated)below measured range (<43.8%)
- #1Claude Opus 5.589.9%
- #2Claude Sonnet 5.581.3%
- #22Nex-N2.5-Mini43.8%
- ~#23LFM2.5-24B-A2BEstimated<43.8%
No published score — estimated from related benchmarks
DeepSWE v1.1Estimated
~#40 of 43 (estimated)~29.4%
- #1Gemini 4 Argon78.8%
- #2DeepSeek V4.1 Flash 101777.0%
- #39Nex-N2.5-Mini36.1%
- ~#40LFM2.5-24B-A2BEstimated29.4%
- #40Hy328.0%
No published score — estimated from related benchmarks
Terminal-Bench 4.0Estimated
~#39 of 99 (estimated)~4.2%
- #1Kimi K3.1 Pro67.2%
- #2Claude Sonnet 5.563.6%
- #38Qwen3.8 27B5.6%
- ~#39LFM2.5-24B-A2BEstimated4.2%
- #39Gemini 3.1 Pro4.0%
No published score — estimated from related benchmarks
LiveCodeBenchEstimated
~#17 of 28 (estimated)~59.8%
- #1Qwen3.8-Omni-Flash92.6%
- #2Qwen3.8 Flash-Next91.9%
- #16Claude Haiku 4.561.5%
- ~#17LFM2.5-24B-A2BEstimated59.8%
- #17GLM-5.3 NVFP453.5%
No published score — estimated from related benchmarks
SciCodeEstimated
~#93 of 118 (estimated)~36.4%
- #1Claude Opus 5.566.9%
- #2Claude Fable 5.163.1%
- #91Qwen3.6 35B A3B36.6%
- ~#93LFM2.5-24B-A2BEstimated36.4%
- #93LongCat 2.036.3%
No published score — estimated from related benchmarks
AA Coding Agent IndexEstimated
~#22 of 24 (estimated)~31.8
- #1Claude Opus 5.561.7
- #2Claude Opus 559.7
- #21Gemini 3.8 Flash33.3
- ~#22LFM2.5-24B-A2BEstimated31.8
- #22GPT-6 Luna31.1
No published score — estimated from related benchmarks
Writing & chat
IFBenchLab-reported
#24 of 13774.7%
- #1MiniMax-M382.9%
- #2Qwen3.8 2.4T A95B82.8%
- #23GPT-5.3 Codex75.4%
- #24LFM2.5-24B-A2B74.7%
- #25Ternary Bonsai 2 27B74.0%
huggingface.co · 2026-10-15
LMArena Text, Non-English (Elo)Estimated
~#44 of 57 (estimated)~1374 Elo
- #1Gemini 4 ArgonFew votes1512
- #2Claude Opus 5.51497
- #43Qwen3 Next 80B A3B Instruct1386
- ~#44LFM2.5-24B-A2BEstimated1374
- #44GLM-4.6VFew votes1361
No published score — estimated from related benchmarks
LMArena Text (Elo)Estimated
~#44 of 57 (estimated)~1393 Elo
- #1Gemini 4 Argon1525
- #2Claude Opus 5.51507
- #43Qwen3 Next 80B A3B Instruct1399
- ~#44LFM2.5-24B-A2BEstimated1393
- #44GLM-4.6VFew votes1378
No published score — estimated from related benchmarks
EQ-Bench Creative Writing v3 (Elo)Estimated
~#18 of 26 (estimated)~1638 Elo
- #1GPT-6 Astra2173
- #2Claude Fable 5.12162
- #17Qwen3.8 27B1671
- ~#18LFM2.5-24B-A2BEstimated1638
- #18Inkling1611
No published score — estimated from related benchmarks
Hard reasoning
GPQA DiamondLab-reported
#96 of 19074.4%
- #1GPT-6 Astra96.1%
- #2Gemini 3.8 Flash95.3%
- #95Mistral Medium 3.574.8%
- #96LFM2.5-24B-A2B74.4%
- #97Nemotron 3.5 Lightning74.3%
huggingface.co · 2026-10-15
Humanity's Last ExamLab-reported
#130 of 1977.4%
- #1Claude Opus 5.561.4%
- #2Claude Fable 5.159.1%
- #129Sarvam 30B7.5%
- #130LFM2.5-24B-A2B7.4%
- #130Llama 3.1 Nemotron Ultra 253B v17.4%
huggingface.co · 2026-10-15
AIME (latest)Estimated
~#22 of 33 (estimated)~66.4%
- #1GLM-5.3 NVFP499.5%
- #2Beam 1.0 501B A23B97.7%
- #21Phi-4-reasoning-plus78.0%
- ~#22LFM2.5-24B-A2BEstimated66.4%
- #22Mistral Large 338.0%
No published score — estimated from related benchmarks
AA Intelligence IndexEstimated
~#75 of 101 (estimated)~12.7
- #1Claude Opus 5.557.6
- #2Claude Sonnet 5.556.0
- #74Nemotron 3 Super 120B A12B12.8
- ~#75LFM2.5-24B-A2BEstimated12.7
- #75Granite 4.2 30B12.7
No published score — estimated from related benchmarks