NVIDIA RTX PRO 4000
24 GB · Blackwell
Live NVIDIA RTX PRO 4000 cloud prices from 2 providers, updated .
2 offerings from 2 providers
| Provider | Per GPU / hour | Action | |
|---|---|---|---|
1 GPU · Affiliate promotion — we may earn a commission. | $0.57 | Launch | |
2 GPUs · $0.48 total | from$0.24 | Launch | |
| |||
Runpod*Up to$500credit 1 GPU | $0.57 | Launch | |
| |||
* We may earn a referral fee or commission from some providers when you sign up through our links. This does not affect ranking or ordering.
NVIDIA RTX PRO 4000 price history
The median NVIDIA RTX PRO 4000 price is up 122% since May 11, 2026.
LLMs that fit on the NVIDIA RTX PRO 4000
Popular open-weight LLMs against 24 GB per GPU: weights plus room for the KV cache, at the best precision that fits. Showing the 12 largest that fit.
Runs on one NVIDIA RTX PRO 4000
- Qwen3.6 35B-A3B4-bit · tight, 4% spare
- Qwen3 32B4-bit · tight, 14% spare
- Gemma 4 31B4-bit · tight, 19% spare
- GLM-4.7 Flash4-bit · 24 GB
- Qwen3.6 27B4-bit · 21 GB
- Mistral Small 3.2 24B4-bit · 18 GB
- gpt-oss-20b4-bit · 17 GB
Needs more than one NVIDIA RTX PRO 4000
- DeepSeek V4 Flash8 GPUs · 4-bit
- Solar Open2 250B8 GPUs · 4-bit, tight
- Qwen3 235B-A22B8 GPUs · 4-bit
- Laguna-S 2.14 GPUs · 4-bit
- gpt-oss-120b4 GPUs · 4-bit
Full table with every precision
Estimated VRAM for popular open-weight LLMs at 16-bit (FP16/BF16), 8-bit (FP8/INT8) and 4-bit (INT4/MXFP4) precision, against 24 GB per GPU.
| Model | Parameters | 16-bit | 8-bit | 4-bit |
|---|---|---|---|---|
| DeepSeek V4 Flash DeepSeek | 284B | — Not released | — Not released | 192 GB Barely fits on 8× |
| Solar Open2 250B Upstage | 250B 15B active | — Not released | 330 GB Too large | 192 GB Tight on 8× · 19% spare |
| Qwen3 235B-A22B Alibaba | 235B 22B active | — Not released | 310 GB Too large | 181 GB 8× · 11 GB free |
| Laguna-S 2.1 Poolside | 118B 8B active | 282 GB Too large | 155 GB 8× · 37 GB free | 90 GB 4× · 5.7 GB free |
| gpt-oss-120b OpenAI | 117B 5.1B active | — Not released | — Not released | 78 GB 4× · 18 GB free |
| Qwen3.6 35B-A3B Alibaba | 35B 3B active | 86 GB 4× · 9.7 GB free | 47 GB Barely fits on 2× | 28 GB 2× · 20 GB free or 1× · 4% spare |
| Qwen3 32B Alibaba | 32.8B | 79 GB 4× · 17 GB free | 43 GB 2× · 4.8 GB free | 25 GB 2× · 23 GB free or 1× · 14% spare |
| Gemma 4 31B Google | 31.3B | 75 GB 4× · 21 GB free | 41 GB 2× · 6.7 GB free | 24 GB 2× · 24 GB free or 1× · 19% spare |
| GLM-4.7 Flash Z.ai | 31.2B | 75 GB 4× · 21 GB free | 41 GB 2× · 6.8 GB free | 24 GB Barely fits on 1× |
| Qwen3.6 27B Alibaba | 27.8B | 67 GB 4× · 29 GB free | 37 GB 2× · 11 GB free | 21 GB 1× · 2.7 GB free |
| Mistral Small 3.2 24B Mistral AI | 24B | 58 GB 4× · 38 GB free | 32 GB 2× · 16 GB free | 18 GB 1× · 5.6 GB free |
| gpt-oss-20b OpenAI | 21B 3.6B active | — Not released | — Not released | 17 GB 1× · 7.5 GB free |
Estimates: model weights plus 20% for KV cache and runtime overhead, at short context lengths. Long contexts and large batches need more. Rows marked “tight” hold the weights but not that full margin. A ×N figure is the total VRAM across N of these GPUs and makes no claim about interconnect throughput. How we estimate this · Start from a model instead
NVIDIA RTX PRO 4000 specs
The NVIDIA RTX PRO 4000 is an enterprise-class GPU built on the Blackwell architecture, featuring 24 GB of memory.
- Architecture
- Blackwell
- Brand
- NVIDIA
- Series
- RTX PRO
