GPUs with 24 GB+ VRAM
17 GPU models with at least 24 GB, ranked by the cheapest verified on-demand rate. VRAM is the binding constraint for most AI workloads: if the model does not fit, the price does not matter.
| GPU | VRAM | On-demand | Spot from | $/hr per GB | Where | |
|---|---|---|---|---|---|---|
| RTX A5000 | 24 GB | $0.27 | $0.16 | $0.01 | RunPod secure cloud | Rent → |
| L4 | 24 GB | $0.39 | $0.22 | $0.02 | RunPod secure cloud | Rent → |
| A40 | 48 GB | $0.44 | $0.35 | $0.01 | RunPod secure cloud | Rent → |
| RTX 3090 | 24 GB | $0.46 | $0.22 | $0.02 | RunPod secure cloud | Rent → |
| RTX A6000 | 48 GB | $0.49 | $0.33 | $0.01 | RunPod secure cloud | Rent → |
| RTX 4090 | 24 GB | $0.69 | $0.34 | $0.03 | RunPod secure cloud | Rent → |
| RTX 6000 Ada | 48 GB | $0.77 | $0.74 | $0.02 | RunPod secure cloud | Rent → |
| L40 | 48 GB | $0.82 | $0.69 | $0.02 | RunPod secure cloud | Rent → |
| RTX 5090 | 32 GB | $0.86 | $0.69 | $0.03 | Spheron on-demand | Rent → |
| L40S | 48 GB | $0.88 | $0.79 | $0.02 | Massed Compute on-demand | Rent → |
| A100 | 80 GB | $0.89 | $0.68 | $0.01 | Jarvislabs on-demand | Rent → |
| RTX PRO 6000 | 96 GB | $1.80 | $1.64 | $0.02 | Nebius on-demand | Rent → |
| GH200 | 96 GB | $1.88 | – | $0.02 | Spheron on-demand | Rent → |
| H100 | 94 GB | $1.99 | $1.40 | $0.02 | Voltage Park on-demand | Rent → |
| MI300X | 192 GB | $2.19 | – | $0.01 | RunPod secure cloud | Rent → |
| B200 | 180 GB | $3.50 | $5.98 | $0.02 | Vultr on-demand | Rent → |
| H200 | 143 GB | $3.62 | $3.59 | $0.03 | Massed Compute on-demand | Rent → |
Other sizes: 24 GB+ · 48 GB+ · 80 GB+ · 140 GB+ · full table.