The NVIDIA RTX 2060 is a consumer-grade GPU built on the Turing architecture, featuring 6 GB of memory with 336 GB/s of memory bandwidth and a 160 W TDP. It delivers 6.5 TFLOPS of FP32 performance. Currently available from 1 provider starting at $0.07/GPU/hour, with a market median of $0.20/GPU/hour across 2 configurations.
Hardware specifications
Same across all providers
Median price across all providers
1 offering from 1 providers
Sorted by price ascending. Compare configurations side-by-side.
LLMs that fit on the NVIDIA RTX 2060
Estimated VRAM for popular open-weight LLMs at 16-bit (FP16/BF16), 8-bit (FP8/INT8) and 4-bit (INT4/MXFP4) precision, against 6 GB per GPU.
| Model | Parameters | 16-bit | 8-bit | 4-bit |
|---|---|---|---|---|
| Granite 4.1 8B IBM | 8.8B | 21 GB Too large | 12 GB Too large | 6.8 GB Tight on 1× · 6% spare |
| Qwen3 8B Alibaba | 8.2B | 20 GB Too large | 11 GB Too large | 6.3 GB Tight on 1× · 14% spare |
| Llama 3.1 8B Instruct Meta | 8B | 19 GB Too large | 11 GB Too large | 6.2 GB Tight on 1× · 16% spare |
| Mistral 7B Instruct v0.3 Mistral AI | 7.2B | 17 GB Too large | 9.6 GB Too large | 5.6 GB Barely fits on 1× |
| Qwen3 4B Alibaba | 4B | 9.7 GB Too large | 5.3 GB Barely fits on 1× | 3.1 GB 1× · 2.9 GB free |
Estimates: model weights plus 20% for KV cache and runtime overhead, at short context lengths. Long contexts and large batches need more. Rows marked “tight” hold the weights but not that full margin. A ×N figure is the total VRAM across N of these GPUs and makes no claim about interconnect throughput. How we estimate this · Start from a model instead
Want more from this page?
See incorrect data?