GPU types & models

Compare 105 GPU types tracked across our provider network. Filter by VRAM, brand and pricing to find the right fit.

Starting from a model instead? Open the model picker

105 GPU types2,480 OfferingsUp to 432 GBCheapest $0.03/hr
PromotedRunpodAffiliate promotion — we may earn a commission.

Serverless GPUs, zero idle cost

Sub-200ms cold starts, autoscale from zero, pay only while your code runs.

Try ServerlessUp to$500signup credit

Available GPU types

Showing 105 of 105 models.

NVIDIA GTX 1070 Ti

8 GB
NVIDIA GTX 1070 Ti

GeForce GTX 1070 Ti 8 GB - higher-clocked Pascal model bridging the gap between the GTX 1070 and GTX 1080.

Starting
$0.03/hr
Avg
$0.08/hr
2providers3 configs
View details

NVIDIA Quadro P2000

5 GB
NVIDIA Quadro P2000

NVIDIA Quadro P2000 5 GB - compact Pascal workstation GPU for CAD, video editing and light AI inference.

Starting
$0.03/hr
Avg
$0.08/hr
2providers4 configs
View details

NVIDIA RTX A2000

12 GB
NVIDIA RTX A2000

NVIDIA RTX A2000 12 GB - compact Ampere professional GPU for CAD, VR development and AI-assisted workflows.

Starting
$0.03/hr
Avg
$0.25/hr
2providers8 configs
View details

NVIDIA Tesla P100

16 GB
NVIDIA Tesla P100

NVIDIA Tesla P100 16 GB HBM2 - Pascal datacenter accelerator for HPC and early deep-learning training workloads.

Starting
$0.03/hr
Avg
$0.22/hr
3providers9 configs
View details

NVIDIA GTX 1070

8 GB
NVIDIA GTX 1070

GeForce GTX 1070 8 GB - mid-range graphics card for 1440p gaming, creative rendering and AI-assisted workflows.

Starting
$0.04/hr
Avg
$0.05/hr
1provider4 configs
View details

NVIDIA GTX Titan X

12 GB
NVIDIA GTX Titan X

NVIDIA GTX Titan X 12 GB - flagship Maxwell prosumer card for rendering, CUDA development and entry AI workloads.

Starting
$0.04/hr
Avg
$0.04/hr
1provider5 configs
View details

NVIDIA RTX 3060 Laptop GPU

6 GB
NVIDIA RTX 3060 Laptop GPU

GeForce RTX 3060 Laptop GPU 6 GB - mobile Ampere card for gaming notebooks and portable AI workloads. Distinct from the desktop RTX 3060 (12 GB).

Starting
$0.04/hr
Avg
$0.06/hr
2providers9 configs
View details

NVIDIA GTX 1080

8 GB
NVIDIA GTX 1080

GeForce GTX 1080 8 GB - high-end Pascal graphics card for 1440p gaming and creative workloads.

Starting
$0.05/hr
Avg
$0.05/hr
1provider4 configs
View details

NVIDIA GTX 1080 Ti

11 GB
NVIDIA GTX 1080 Ti

GeForce GTX 1080 Ti 11 GB - flagship Pascal card still capable for 4K gaming, rendering and entry AI workloads.

Starting
$0.05/hr
Avg
$0.07/hr
2providers7 configs
View details

NVIDIA GTX 1650

4 GB
NVIDIA GTX 1650

GeForce GTX 1650 4 GB - entry-level Turing graphics card for 1080p gaming and basic content creation.

Starting
$0.05/hr
Avg
$0.05/hr
1provider1 configs
View details

NVIDIA Quadro P4000

8 GB
NVIDIA Quadro P4000

NVIDIA Quadro P4000 8 GB - single-slot Pascal workstation GPU for VR, rendering and creative production.

Starting
$0.05/hr
Avg
$0.06/hr
2providers5 configs
View details

NVIDIA Titan Xp

12 GB
NVIDIA Titan Xp

NVIDIA Titan Xp 12 GB - flagship Pascal prosumer card for content creation, rendering and entry AI workloads.

Starting
$0.05/hr
Avg
$0.08/hr
1provider7 configs
View details

NVIDIA GTX 1660 Super

6 GB
NVIDIA GTX 1660 Super

GeForce GTX 1660 Super 6 GB - refreshed Turing card with faster GDDR6 memory for 1080p gaming.

Starting
$0.06/hr
Avg
$0.07/hr
2providers3 configs
View details

NVIDIA Quadro M4000

8 GB
NVIDIA Quadro M4000

NVIDIA Quadro M4000 8 GB - professional graphics card for AI, machine learning and scientific computing.

Starting
$0.06/hr
Avg
$0.06/hr
1provider1 configs
View details

NVIDIA RTX 3060

12 GB
NVIDIA RTX 3060

GeForce RTX 3060 12 GB - mid-range graphics card for 1440p gaming, creative rendering and AI-assisted workflows.

Starting
$0.06/hr
Avg
$0.14/hr
4providers26 configs
View details

NVIDIA RTX 3060 Ti

8 GB
NVIDIA RTX 3060 Ti

GeForce RTX 3060 Ti 8 GB - mid-range graphics card for 1440p gaming, creative rendering and AI-assisted workflows.

Starting
$0.06/hr
Avg
$0.10/hr
3providers6 configs
View details

NVIDIA Tesla P4

8 GB
NVIDIA Tesla P4

NVIDIA Tesla P4 8 GB - low-power Pascal inference accelerator for video transcoding and edge AI workloads.

Starting
$0.06/hr
Avg
$0.06/hr
1provider1 configs
View details

NVIDIA GTX 1060

6 GB
NVIDIA GTX 1060

GeForce GTX 1060 6 GB - mid-range Pascal graphics card for 1080p gaming and lightweight AI experimentation.

Starting
$0.07/hr
Avg
$0.08/hr
1provider3 configs
View details

NVIDIA RTX 2060

6 GB
NVIDIA RTX 2060

GeForce RTX 2060 6 GB - entry-level Turing RTX card bringing real-time ray-tracing to mainstream gaming.

Starting
$0.07/hr
Avg
$0.15/hr
2providers7 configs
View details

NVIDIA RTX 2070

8 GB
NVIDIA RTX 2070

GeForce RTX 2070 8 GB - mid-range Turing card for 1440p ray-traced gaming and creator workloads.

Starting
$0.07/hr
Avg
$0.08/hr
2providers4 configs
View details

NVIDIA RTX 2070 Super

8 GB
NVIDIA RTX 2070 Super

GeForce RTX 2070 Super 8 GB - refreshed Turing model with more cores for creators and deep-learning hobbyists.

Starting
$0.07/hr
Avg
$0.09/hr
2providers6 configs
View details

NVIDIA RTX 4060

8 GB
NVIDIA RTX 4060

GeForce RTX 4060 8 GB - efficient GPU for 1440p gaming, DLSS 3 frame generation and lightweight AI projects.

Starting
$0.07/hr
Avg
$0.94/hr
2providers7 configs
View details

NVIDIA Tesla V100 16GB

16 GB
NVIDIA Tesla V100 16GB

NVIDIA Tesla V100 16 GB Volta - legacy datacenter accelerator still popular for CUDA development, scientific compute and AI research.

Starting
$0.07/hr
Avg
$0.52/hr
8providers32 configs
View details

NVIDIA RTX 2080 Ti

11 GB
NVIDIA RTX 2080 Ti

GeForce RTX 2080 Ti 11 GB - high-end graphics card for 4K gaming, creative rendering and AI-assisted workflows.

Starting
$0.08/hr
Avg
$0.12/hr
2providers6 configs
View details

NVIDIA RTX 3070

8 GB
NVIDIA RTX 3070

GeForce RTX 3070 8 GB - mid-range graphics card for 1440p gaming, creative rendering and AI-assisted workflows.

Starting
$0.08/hr
Avg
$0.40/hr
2providers16 configs
View details

NVIDIA RTX 3080

10 GB
NVIDIA RTX 3080

GeForce RTX 3080 10 GB - high-end graphics card for 4K gaming, creative rendering and AI-assisted workflows.

Starting
$0.08/hr
Avg
$0.24/hr
1provider15 configs
View details

NVIDIA RTX A4000

16 GB
NVIDIA RTX A4000

NVIDIA RTX A4000 16 GB - compact professional GPU for CAD, VR development and AI-assisted workflows.

Starting
$0.08/hr
Avg
$0.28/hr
8providers34 configs
View details

NVIDIA Tesla P40

24 GB
NVIDIA Tesla P40

NVIDIA Tesla P40 24 GB - Pascal inference accelerator with high VRAM, popular for self-hosted LLM inference on a budget.

Starting
$0.08/hr
Avg
$0.11/hr
2providers4 configs
View details

NVIDIA GTX 1650 Ti

4 GB
NVIDIA GTX 1650 Ti

GeForce GTX 1650 Ti 4 GB - mid-range graphics card for 1440p gaming, creative rendering and AI-assisted workflows.

Starting
$0.09/hr
Avg
$0.09/hr
1provider1 configs
View details

NVIDIA Quadro RTX 5000

16 GB
NVIDIA Quadro RTX 5000

NVIDIA Quadro RTX 5000 16 GB - Turing workstation GPU with Tensor Cores for VR, rendering and AI development.

Starting
$0.09/hr
Avg
$0.09/hr
1provider1 configs
View details

NVIDIA RTX 2060 Super

8 GB
NVIDIA RTX 2060 Super

GeForce RTX 2060 Super 8 GB - refreshed Turing model with more VRAM for 1440p gaming and AI experimentation.

Starting
$0.09/hr
Avg
$0.09/hr
1provider1 configs
View details

NVIDIA RTX 3090

24 GB
NVIDIA RTX 3090

GeForce RTX 3090 24 GB - powerhouse card for gaming, 3D rendering and AI research on a budget.

Starting
$0.09/hr
Avg
$0.27/hr
6providers62 configs
View details

NVIDIA GTX 1660 Ti

6 GB
NVIDIA GTX 1660 Ti

GeForce GTX 1660 Ti 6 GB - higher-clocked Turing model for 1080p gaming and light creator workloads.

Starting
$0.10/hr
Avg
$0.10/hr
1provider1 configs
View details

NVIDIA RTX 4070 Super

12 GB
NVIDIA RTX 4070 Super

GeForce RTX 4070 Super 12 GB - refreshed Ada model with more cores for creators and deep-learning hobbyists.

Starting
$0.10/hr
Avg
$0.18/hr
2providers11 configs
View details

NVIDIA RTX 5060

8 GB
NVIDIA RTX 5060

GeForce RTX 5060 8 GB Blackwell - rumoured mid-range card targeting efficient 1440p gaming and entry AI workloads.

Starting
$0.10/hr
Avg
$0.10/hr
2providers2 configs
View details

NVIDIA RTX 5060 Ti

16 GB
NVIDIA RTX 5060 Ti

GeForce RTX 5060 Ti 16 GB Blackwell - rumoured mid-range card targeting efficient 1440p gaming and entry AI workloads.

Starting
$0.10/hr
Avg
$0.18/hr
3providers36 configs
View details

NVIDIA RTX 4060 Ti

8 GB
NVIDIA RTX 4060 Ti

GeForce RTX 4060 Ti 8 GB - efficient GPU for 1440p gaming, DLSS 3 frame generation and lightweight AI projects.

Starting
$0.11/hr
Avg
$0.16/hr
3providers9 configs
View details

NVIDIA T4

16 GB
NVIDIA T4

NVIDIA T4 16 GB Tensor Core GPU (Turing) widely used for cost-efficient AI inference, video transcoding and lightweight training workloads.

Starting
$0.11/hr
Avg
$0.17/hr
3providers6 configs
View details

NVIDIA RTX 2000 Ada Generation

16 GB
NVIDIA RTX 2000 Ada Generation

NVIDIA RTX 2000 Ada Generation 16 GB - compact professional GPU for CAD, VR development and AI-assisted workflows.

Starting
$0.12/hr
Avg
$0.17/hr
2providers3 configs
View details

NVIDIA RTX 4070 Laptop GPU

8 GB
NVIDIA RTX 4070 Laptop GPU

GeForce RTX 4070 Laptop GPU 8 GB - mobile Ada Lovelace card for gaming notebooks and portable AI workloads. Distinct from the desktop RTX 4070 (12 GB).

Starting
$0.13/hr
Avg
$0.13/hr
1provider1 configs
View details

NVIDIA GTX 1050

2 GB
NVIDIA GTX 1050

GeForce GTX 1050 2 GB - entry-level graphics card for lightweight AI inference and basic content creation.

Starting
$0.14/hr
Avg
$0.14/hr
1provider1 configs
View details

NVIDIA RTX 4000 SFF Ada Generation

20 GB
NVIDIA RTX 4000 SFF Ada Generation

The NVIDIA RTX™ 4000 SFF Ada Generation packs a punch with the features, capabilities, and performance demanded by professionals—all in a compact GPU design.

Starting
$0.14/hr
Avg
$0.29/hr
2providers2 configs
View details

NVIDIA RTX 4090

24 GB
RTX 4090 · Founders Edition referenceRTX 4090 · Founders Edition reference

GeForce RTX 4090 24 GB - ultimate consumer GPU for 8K gaming, neural rendering and AI model training.

Starting
$0.14/hr
Avg
$0.64/hr
11providers80 configs
View details

NVIDIA RTX 4080

16 GB
NVIDIA RTX 4080

GeForce RTX 4080 16 GB - high-end Ada Lovelace GPU delivering excellent 4K ray-tracing performance and generative-AI acceleration.

Starting
$0.15/hr
Avg
$0.27/hr
4providers12 configs
View details

NVIDIA RTX 5070

12 GB
NVIDIA RTX 5070

Rumoured GeForce RTX 5070 12 GB Blackwell - expected mid-range card targeting efficient 1440p gaming and entry AI workloads.

Starting
$0.15/hr
Avg
$0.23/hr
2providers13 configs
View details

NVIDIA RTX 3080 Ti

12 GB
NVIDIA RTX 3080 Ti

GeForce RTX 3080 Ti 12 GB - enthusiast graphics card for 4K gaming, creative rendering and entry-level AI experimentation.

Starting
$0.16/hr
Avg
$0.32/hr
3providers9 configs
View details

NVIDIA RTX 4070

12 GB
NVIDIA RTX 4070

GeForce RTX 4070 12 GB Ada - efficient GPU for 1440p gaming, DLSS 3 frame generation and lightweight AI projects.

Starting
$0.16/hr
Avg
$0.17/hr
2providers5 configs
View details

NVIDIA RTX 4070 Ti

12 GB
NVIDIA RTX 4070 Ti

GeForce RTX 4070 Ti 12 GB - higher-clocked Ada GPU ideal for 4K esports, Blender rendering and local generative-AI tasks.

Starting
$0.16/hr
Avg
$0.27/hr
2providers5 configs
View details

NVIDIA RTX A5000

24 GB
NVIDIA RTX A5000

NVIDIA RTX A5000 24 GB - versatile pro GPU for large-scene rendering, VR and deep-learning acceleration.

Starting
$0.16/hr
Avg
$0.90/hr
7providers20 configs
View details

NVIDIA Tesla V100 32GB

32 GB
NVIDIA Tesla V100 32GB

NVIDIA Tesla V100 32 GB Volta - legacy datacenter accelerator still popular for CUDA development, scientific compute and AI research. Shipped in both SXM2 and PCIe form.

Starting
$0.16/hr
Avg
$2.06/hr
5providers12 configs
View details

NVIDIA Titan RTX

24 GB
NVIDIA Titan RTX

NVIDIA Titan RTX 24 GB - flagship Turing prosumer card with Tensor Cores for AI research, 8K video editing and rendering.

Starting
$0.16/hr
Avg
$0.19/hr
1provider5 configs
View details

NVIDIA RTX 4000 Ada Generation

20 GB
NVIDIA RTX 4000 Ada Generation

NVIDIA RTX 4000 Ada 20 GB - single-slot Ada Lovelace GPU optimised for compact workstations, AI inferencing and real-time graphics.

Starting
$0.17/hr
Avg
$0.43/hr
5providers6 configs
View details

NVIDIA RTX 3070 Ti

8 GB
NVIDIA RTX 3070 Ti

GeForce RTX 3070 Ti 8 GB - mid-range graphics card for 1440p gaming, creative rendering and AI-assisted workflows.

Starting
$0.19/hr
Avg
$0.19/hr
1provider1 configs
View details

NVIDIA RTX 5070 Ti

16 GB
NVIDIA RTX 5070 Ti

Leaked GeForce RTX 5070 Ti 16 GB - projected sweet-spot Blackwell GPU for creators, gamers and small-scale machine-learning.

Starting
$0.19/hr
Avg
$0.78/hr
3providers17 configs
View details

NVIDIA CMP 170HX

8 GB
NVIDIA CMP 170HX

NVIDIA CMP 170HX 8 GB HBM2e - passively-cooled Ampere GA100 mining card. Fuse- and firmware-locked to a PCIe 1.1 x4 link (~1 GB/s to the host) with heavily restricted general compute, so it is only useful for memory-bandwidth-bound work.

Starting
$0.20/hr
Avg
$0.33/hr
2providers12 configs
View details

NVIDIA RTX PRO 4000

24 GB
NVIDIA RTX PRO 4000

NVIDIA RTX PRO 4000 Blackwell 24 GB GDDR7 ECC - workstation GPU for professional content creation and AI workloads.

Starting
$0.20/hr
Avg
$0.35/hr
2providers9 configs
View details

NVIDIA RTX 5080

16 GB
NVIDIA RTX 5080

GeForce RTX 5080 16 GB Blackwell - anticipated high-end successor delivering faster ray-tracing and AI inference.

Starting
$0.21/hr
Avg
$0.38/hr
4providers19 configs
View details

NVIDIA RTX 4070 Ti Super

16 GB
NVIDIA RTX 4070 Ti Super

GeForce RTX 4070 Ti Super 16 GB

Starting
$0.22/hr
Avg
$0.36/hr
2providers5 configs
View details

NVIDIA RTX 4080 Super

16 GB
NVIDIA RTX 4080 Super

GeForce RTX 4080 Super 16 GB - refreshed Ada model with more cores for creators and deep-learning hobbyists.

Starting
$0.23/hr
Avg
$0.40/hr
3providers8 configs
View details

NVIDIA A10

24 GB
NVIDIA A10

NVIDIA A10 24 GB.

Starting
$0.24/hr
Avg
$1.08/hr
5providers7 configs
View details

Intel Arc Pro B70

32 GB
Intel Arc Pro B70

Intel Arc Pro B70 32 GB GDDR6 - Big Battlemage workstation and inference card, pairing 32 Xe2 cores and 256 XMX engines with 32 GB of memory for large-model inference, rendering and visualization.

Starting
$0.25/hr
Avg
$0.25/hr
1provider1 configs
View details

NVIDIA Quadro RTX 8000

48 GB
NVIDIA Quadro RTX 8000

NVIDIA Quadro RTX 8000 48 GB - ultimate AI and visual computing performance for the data center.

Starting
$0.25/hr
Avg
$0.25/hr
1provider4 configs
View details

NVIDIA RTX A4500

20 GB
NVIDIA RTX A4500

NVIDIA RTX A4500 20 GB - Ampere-based workstation card for real-time ray-tracing, simulation and AI inference.

Starting
$0.25/hr
Avg
$0.25/hr
1provider1 configs
View details

NVIDIA A100 80GB

Trending
80 GB
A100 80GB · PCIe reference designA100 80GB · PCIe reference design

NVIDIA A100 80 GB Tensor Core GPU - the proven workhorse for deep-learning training, data analytics and accelerated HPC.

Starting
$0.27/hr
Avg
$1.61/hr
16providers107 configs
View details

NVIDIA L4

24 GB
NVIDIA L4

The NVIDIA L4 Tensor Core GPU powered by the NVIDIA Ada Lovelace architecture delivers universal, energy-efficient acceleration for video, AI, visual computing, graphics, virtualization, and more.

Starting
$0.27/hr
Avg
$0.80/hr
9providers20 configs
View details

NVIDIA RTX 3090 Ti

24 GB
NVIDIA RTX 3090 Ti

GeForce RTX 3090 Ti 24 GB - high-end graphics card for gaming, creative rendering and AI-assisted workflows.

Starting
$0.31/hr
Avg
$0.39/hr
2providers2 configs
View details

NVIDIA RTX 5000 Ada Generation

32 GB
NVIDIA RTX 5000 Ada Generation

NVIDIA RTX 5000 Ada 32 GB - single-slot Ada Lovelace GPU optimised for compact workstations, AI inferencing and real-time graphics.

Starting
$0.34/hr
Avg
$0.49/hr
2providers4 configs
View details

NVIDIA RTX A6000

48 GB
NVIDIA RTX A6000

NVIDIA RTX A6000 48 GB - flagship Ampere workstation GPU powering complex VFX, digital twins and AI pipelines.

Starting
$0.35/hr
Avg
$0.77/hr
13providers58 configs
View details

NVIDIA RTX 4500 Ada Generation

24 GB
NVIDIA RTX 4500 Ada Generation

NVIDIA RTX 4500 Ada 24 GB - Ada Lovelace workstation GPU for advanced visualization, simulation and AI development.

Starting
$0.36/hr
Avg
$0.37/hr
1provider3 configs
View details

NVIDIA RTX PRO 4500

32 GB
NVIDIA RTX PRO 4500

NVIDIA RTX PRO 4500 Blackwell 32GB GDDR7 with error-correcting code (ECC)

Starting
$0.36/hr
Avg
$1.00/hr
4providers8 configs
View details

NVIDIA L40S

48 GB
L40S · PCIe reference designL40S · PCIe reference design

NVIDIA L40S 48 GB Ada GPU, tuned for faster generative-AI inference and graphics workloads in datacenter environments.

Starting
$0.38/hr
Avg
$1.23/hr
13providers53 configs
View details

NVIDIA A30

24 GB
NVIDIA A30

NVIDIA A30 24 GB Ampere GPU designed for mainstream enterprise AI inference and mixed workloads.

Starting
$0.39/hr
Avg
$0.42/hr
4providers6 configs
View details

NVIDIA RTX 5090

Trending
32 GB
RTX 5090 · Founders Edition referenceRTX 5090 · Founders Edition reference

GeForce RTX 5090 32 GB Blackwell flagship - tipped to exceed RTX 4090 in gaming, rendering and generative-AI.

Starting
$0.41/hr
Avg
$0.90/hr
12providers66 configs
View details

NVIDIA A800 80GB PCIe

80 GB
NVIDIA A800 80GB PCIe

NVIDIA A800 80 GB PCIe - China-market Ampere accelerator with the same compute as A100 but reduced NVLink bandwidth.

Starting
$0.47/hr
Avg
$0.47/hr
1provider2 configs
View details

NVIDIA A16

16 GB
NVIDIA A16

NVIDIA A16 16 GB multi-instance GPU tailored for virtual desktops, AI inference and mixed graphics workloads in the cloud.

Starting
$0.48/hr
Avg
$0.52/hr
2providers11 configs
View details

NVIDIA B300 MIG 34GB

34 GB
NVIDIA B300 MIG 34GB

NVIDIA B300 MIG 1g.34gb slice - a partitioned Blackwell instance providing 34 GB of memory and a fraction of the full B300 compute for isolated AI inference and lightweight training workloads.

Starting
$0.50/hr
Avg
$0.50/hr
1provider1 configs
View details

NVIDIA RTX PRO 6000

96 GB
NVIDIA RTX PRO 6000

NVIDIA RTX PRO 6000 96 GB - universal AI and visual computing performance for the data center.

Starting
$0.50/hr
Avg
$2.28/hr
17providers75 configs
View details

NVIDIA RTX 6000 Ada Generation

48 GB
NVIDIA RTX 6000 Ada Generation

NVIDIA RTX 6000 Ada 48 GB - top-tier Ada workstation card delivering 91 TFLOPS for advanced visualization and AI training.

Starting
$0.56/hr
Avg
$1.10/hr
9providers30 configs
View details

NVIDIA A40

48 GB
NVIDIA A40

NVIDIA A40 48 GB workstation GPU balancing real-time ray-tracing, AI acceleration and professional graphics rendering.

Starting
$0.59/hr
Avg
$1.72/hr
4providers12 configs
View details

NVIDIA RTX PRO 5000

48 GB
NVIDIA RTX PRO 5000

NVIDIA RTX PRO 5000 Blackwell 48 GB GDDR7 ECC - workstation GPU for advanced visualization, simulation and AI development.

Starting
$0.60/hr
Avg
$0.82/hr
2providers14 configs
View details

NVIDIA RTX 4090 D

24 GB
NVIDIA RTX 4090 D

GeForce RTX 4090 D 24 GB - China-market Ada Lovelace SKU with slightly reduced CUDA cores compared to the standard RTX 4090.

Starting
$0.67/hr
Avg
$0.67/hr
1provider2 configs
View details

NVIDIA RTX 6000

24 GB
NVIDIA RTX 6000

NVIDIA RTX 6000 24 GB

Starting
$0.69/hr
Avg
$0.72/hr
2providers2 configs
View details

NVIDIA RTX PRO 6000 MIG 24GB

24 GB
NVIDIA RTX PRO 6000 MIG 24GB

NVIDIA RTX PRO 6000 Blackwell Server Edition MIG 1g.24gb slice - a partitioned instance providing 24 GB of memory and ~1/4 of the full GPU compute for isolated AI inference and lightweight training workloads.

Starting
$0.69/hr
Avg
$0.69/hr
1provider1 configs
View details

NVIDIA L40

48 GB
NVIDIA L40

NVIDIA L40 48 GB Ada Lovelace GPU delivering advanced ray-tracing and AI performance for enterprise visualization and generative content.

Starting
$0.79/hr
Avg
$1.12/hr
8providers45 configs
View details

Intel Gaudi 2

96 GB
Intel Gaudi 2

Intel Gaudi 2 AI accelerator - High performance acceleration for GenAI and LLMs.

Starting
$1.01/hr
Avg
$1.07/hr
2providers5 configs
View details

NVIDIA RTX PRO 6000D

84 GB
NVIDIA RTX PRO 6000D

NVIDIA RTX PRO 6000D Blackwell Server Edition 84 GB GDDR7 - China-market cut of the RTX PRO 6000 with less memory, capped memory bandwidth and lower tensor throughput to meet US export rules.

Starting
$1.07/hr
Avg
$1.23/hr
1provider6 configs
View details

NVIDIA RTX PRO 6000 MIG 48GB

48 GB
NVIDIA RTX PRO 6000 MIG 48GB

NVIDIA RTX PRO 6000 Blackwell Server Edition MIG 2g.48gb slice - a partitioned instance providing 48 GB of memory and ~1/2 of the full GPU compute for isolated AI inference and medium training workloads.

Starting
$1.29/hr
Avg
$1.29/hr
1provider1 configs
View details

NVIDIA A100 40GB

40 GB
NVIDIA A100 40GB

NVIDIA A100 40 GB offers affordable access to Ampere Tensor Cores for research AI training, inference and scientific computing.

Starting
$1.40/hr
Avg
$1.89/hr
4providers13 configs
View details

AMD Instinct MI300X

192 GB
AMD Instinct MI300X

AMD Instinct MI300X 192 GB HBM3 - CDNA 3 accelerator targeting large-language-model training and high-performance computing.

Starting
$1.71/hr
Avg
$2.54/hr
3providers6 configs
View details

NVIDIA H100

80 GB
H100 · PCIe reference designH100 · PCIe reference design

Flagship NVIDIA H100 Tensor Core GPU with 80 GB HBM3 for exascale HPC, large-language-model training and low-latency AI inference.

Starting
$1.75/hr
Avg
$3.33/hr
22providers103 configs
View details

NVIDIA H100 NVL

94 GB
NVIDIA H100 NVL

NVIDIA H100 NVL dual-GPU solution offering 2x94 GB HBM3 for ultra-large LLM inference and memory-bound AI workloads.

Starting
$2.08/hr
Avg
$3.19/hr
5providers9 configs
View details

AMD Instinct MI325X

256 GB
AMD Instinct MI325X

AMD Instinctâ„¢ MI325X accelerators are designed to deliver leadership performance for Generative AI workloads and HPC applications.

Starting
$2.25/hr
Avg
$2.88/hr
2providers5 configs
View details

NVIDIA RTX PRO 6000 CC

96 GB
NVIDIA RTX PRO 6000 CC

NVIDIA RTX PRO 6000 Blackwell 96 GB GDDR7 with Confidential Computing enabled - hardware-isolated, encrypted execution for secure AI and visual computing in the data center.

Starting
$2.26/hr
Avg
$2.26/hr
1provider1 configs
View details

NVIDIA GH200

96 GB
NVIDIA GH200

NVIDIA GH200 96 GB - high-performance GPU for large-scale AI training and scientific computing.

Starting
$2.29/hr
Avg
$3.47/hr
2providers2 configs
View details

NVIDIA H200

141 GB
NVIDIA H200

NVIDIA H200 Tensor Core GPU with 141 GB HBM3e, optimized for generative AI, transformer models and data-intensive HPC simulations.

Starting
$2.48/hr
Avg
$4.94/hr
15providers44 configs
View details

AMD Instinct MI355X

288 GB
AMD Instinct MI355X

Built on the 4th Gen AMD CDNAâ„¢ architecture, AMD Instinctâ„¢ MI355X GPUs deliver leadership AI and HPC performance.

Starting
$2.95/hr
Avg
$5.38/hr
2providers5 configs
View details

NVIDIA H200 NVL

141 GB
NVIDIA H200 NVL

Dual-board NVIDIA H200 NVL (2x141 GB) accelerator designed for trillion-parameter model inference and massive memory bandwidth.

Starting
$3.79/hr
Avg
$5.56/hr
3providers11 configs
View details

NVIDIA B200

180 GB
NVIDIA B200

Next-generation NVIDIA Blackwell B200 with 180 GB HBM3e delivers breakthrough performance for frontier AI training and scientific computing.

Starting
$4.11/hr
Avg
$7.23/hr
11providers39 configs
View details

NVIDIA B300

Trending
288 GB
DGX B300 · representative systemDGX B300 · representative system

Next-generation NVIDIA Blackwell B300 with 288 GB HBM3e delivers breakthrough performance for AI training and scientific computing.

Starting
$4.95/hr
Avg
$9.38/hr
12providers21 configs
View details

AMD Instinct MI350X

288 GB
AMD Instinct MI350X

AMD Instinct MI350X 288 GB HBM3E - air-cooled CDNA 4 accelerator with 8 TB/s of memory bandwidth for large-model inference and AI training. Lower board power and clocks than the liquid-cooled MI355X.

Starting
$5.49/hr
Avg
$5.49/hr
1provider1 configs
View details

NVIDIA B200 CC

180 GB
NVIDIA B200 CC

NVIDIA Blackwell B200 180 GB HBM3e with Confidential Computing enabled - hardware-isolated, encrypted execution for frontier AI training and inference on shared infrastructure.

Starting
$7.72/hr
Avg
$7.72/hr
1provider3 configs
View details

NVIDIA B300 CC

288 GB
NVIDIA B300 CC

NVIDIA Blackwell B300 288 GB HBM3e with Confidential Computing enabled - hardware-isolated, encrypted execution for large-scale AI training and reasoning workloads.

Starting
$9.72/hr
Avg
$9.72/hr
1provider2 configs
View details

NVIDIA GB300

288 GB
NVIDIA GB300

NVIDIA GB300 Grace Blackwell Ultra Superchip pairs an Arm-based Grace CPU with a B300 GPU featuring 288 GB HBM3e, designed for trillion-parameter AI training and reasoning workloads.

Starting
$10.95/hr
Avg
$10.95/hr
1provider3 configs
View details

NVIDIA A2

16 GB
NVIDIA A2

NVIDIA A2 Tensor Core GPU - Entry-level GPU that brings NVIDIA AI to any server.

Starting
N/A
Avg
N/A
1provider0 configs
View details

NVIDIA A30 12GB vGPU

12 GB
NVIDIA A30 12GB vGPU

NVIDIA A30 12 GB vGPU profile - half of a 24 GB A30 Ampere GPU, for mainstream enterprise inference that does not need a full card.

Starting
N/A
Avg
N/A
1provider0 configs
View details

Browse by group

Curated GPU groups for faster discovery.

Frequently asked questions

What's the cheapest cloud GPU right now?
Cloud GPUs on GPUs.io start at $0.03 per GPU-hour. We continuously compare 2480 configurations across 32 providers and normalize every price to $/GPU-hour, so the lowest available on-demand rate always rises to the top of the list.
Which GPU should I choose for training vs. inference?
For large-scale training, high-VRAM data-center cards such as the NVIDIA H100, H200, A100 and AMD MI300X are the usual choice. For inference and lighter workloads, cards like the L40S, RTX 4090, RTX 5090 and A10 offer better price-performance. The workload guide above breaks this down in more detail.
How many cloud GPUs and providers does GPUs.io compare?
GPUs.io tracks 105 GPU models across 32 cloud providers, covering 2480 individual configurations. Every offer is normalized to $/GPU-hour so you can compare like for like.
Are these GPU prices up to date?
Yes. We refresh on-demand, spot and reserved pricing from each provider's public sources on an ongoing basis, so the rates shown reflect current market pricing rather than stale list prices.