What runs this LLM?
Pick the model you want to serve. We size it from the released checkpoint and list the cheapest configurations you can rent today that hold it — with the on-demand and serverless rate for each.
1 · Choose a model
Released at 4-bit only — never sized above the checkpoint it shipped as.
2 · What it needs
Kimi K2.5 at 4-bit
714 GB of VRAM
at short context — measured from the released checkpoint, not estimated from parameter count.
- Model weights
- 595 GB
- KV cachefolded into overhead
- —
- Runtime overhead20% of weights
- 119 GB
About this model
- Parameters
- 1T
- Active per token
- 32B
- Released at
- 4-bit
- Measured weights
- 595 GB
3 · Where to run it
Bookable configurations
Cheapest first, checked against 98 GPU types with live bookable capacity.
| Configuration | Total VRAM | On-demand | Serverless | GPU details |
|---|---|---|---|---|
| 8× NVIDIA A100 80GBTight fit | 640 GB 74 GB short of the margin | $5.68/hr $0.71/GPU-hr  Vast.ai | $15.75/hr $1.97/GPU-hr  Verda | See all prices |
| 8× NVIDIA RTX PRO 6000 | 768 GB 54 GB free | $8.00/hr $1.00/GPU-hr  Lium | $16.63/hr $2.08/GPU-hr Verda | See all prices |
| 8× Intel Gaudi 2 | 768 GB 54 GB free | $8.31/hr $1.04/GPU-hr  Cyfuture AI | — | See all prices |
| 4× AMD Instinct MI300X | 768 GB 54 GB free | $11.36/hr $2.84/GPU-hr Cyfuture AI | — | See all prices |
| 4× AMD Instinct MI325X | 1,024 GB 310 GB free | $12.35/hr $3.09/GPU-hr Cyfuture AI | — | See all prices |
| 8× NVIDIA H100Tight fit | 640 GB 74 GB short of the margin | $14.96/hr $1.87/GPU-hr Vast.ai | $28.60/hr $3.58/GPU-hr Verda | See all prices |
| 4× NVIDIA B200 | 720 GB 5.8 GB free | $23.52/hr $5.88/GPU-hr Vast.ai | $26.88/hr $6.72/GPU-hr Verda | See all prices |
| 4× NVIDIA B200 CC | 720 GB 5.8 GB free | $24.93/hr $6.23/GPU-hr Verda | — | See all prices |
Showing the 8 cheapest. Model weights plus 20% for runtime overhead, from measured checkpoint sizes; a stated context length adds its KV cache on top. Each price is the cheapest bookable rate for that exact instance size, for the whole configuration — the cheaper of the two is highlighted and orders the table. A ×N figure is total VRAM across N cards and makes no claim about interconnect throughput.
How this is worked out
Weight sizes are measured from the actual checkpoint files on Hugging Face — never derived from parameter count, which gets quantized releases wrong. On top of the weights we assume 20% for activations, CUDA context and allocator slack. Stating a context length adds its KV cache explicitly, computed only for architectures whose cache shape the config states unambiguously.
A configuration that holds the weights and cache but not that full margin is marked as a tight fit rather than hidden — it will load, and may well run at batch size one, but expect trouble under load.
Prices are the cheapest bookable rate for that exact instance size, refreshed with the rest of the catalog.