NVIDIA A30 12GB vGPU
12 GB · Ampere
Prices updated .
No current offerings
1 offering from 0 providers
No price history available
Price tracking data will appear here once available
LLMs that fit on the NVIDIA A30 12GB vGPU
Popular open-weight LLMs against 12 GB per GPU: weights plus room for the KV cache, at the best precision that fits.
Runs on one NVIDIA A30 12GB vGPU
- Gemma 3 12B4-bit · 9.4 GB
- Granite 4.1 8B8-bit · 12 GB
- Qwen3 8B8-bit · 11 GB
- Llama 3.1 8B Instruct8-bit · 11 GB
- Mistral 7B Instruct v0.38-bit · 9.6 GB
- Qwen3 4B16-bit · 9.7 GB
Full table with every precision
Estimated VRAM for popular open-weight LLMs at 16-bit (FP16/BF16), 8-bit (FP8/INT8) and 4-bit (INT4/MXFP4) precision, against 12 GB per GPU.
| Model | Parameters | 16-bit | 8-bit | 4-bit |
|---|---|---|---|---|
| Gemma 3 12B Google | 12.2B | 29 GB Too large | 16 GB Too large | 9.4 GB 1× · 2.6 GB free |
| Granite 4.1 8B IBM | 8.8B | 21 GB Too large | 12 GB Barely fits on 1× | 6.8 GB 1× · 5.2 GB free |
| Qwen3 8B Alibaba | 8.2B | 20 GB Too large | 11 GB 1× · 1.2 GB free | 6.3 GB 1× · 5.7 GB free |
| Llama 3.1 8B Instruct Meta | 8B | 19 GB Too large | 11 GB 1× · 1.4 GB free | 6.2 GB 1× · 5.8 GB free |
| Mistral 7B Instruct v0.3 Mistral AI | 7.2B | 17 GB Too large | 9.6 GB 1× · 2.4 GB free | 5.6 GB 1× · 6.4 GB free |
| Qwen3 4B Alibaba | 4B | 9.7 GB 1× · 2.3 GB free | 5.3 GB 1× · 6.7 GB free | 3.1 GB 1× · 8.9 GB free |
Estimates: model weights plus 20% for KV cache and runtime overhead, at short context lengths. Long contexts and large batches need more. Rows marked “tight” hold the weights but not that full margin. A ×N figure is the total VRAM across N of these GPUs and makes no claim about interconnect throughput. How we estimate this · Start from a model instead
NVIDIA A30 12GB vGPU specs
The NVIDIA A30 12GB vGPU is an enterprise-class GPU built on the Ampere architecture, featuring 12 GB of memory.
- Architecture
- Ampere
- Brand
- NVIDIA
- Series
- A30