GPUs with 96 GB+ VRAM
5 GPU models with at least 96 GB, ranked by the cheapest verified on-demand rate. VRAM is the binding constraint for most AI workloads: if the model does not fit, the price does not matter.
| GPU | VRAM | On-demand | Spot from | $/hr per GB | Where | |
|---|---|---|---|---|---|---|
| RTX PRO 6000 | 96 GB | $1.80 | $1.64 | $0.02 | Nebius on-demand | Rent → |
| GH200 | 96 GB | $1.88 | – | $0.02 | Spheron on-demand | Rent → |
| MI300X | 192 GB | $2.19 | – | $0.01 | RunPod secure cloud | Rent → |
| B200 | 180 GB | $3.50 | $5.98 | $0.02 | Vultr on-demand | Rent → |
| H200 | 143 GB | $3.62 | $3.59 | $0.03 | Massed Compute on-demand | Rent → |
FAQ
What is the cheapest 96 GB+ GPU to rent?
The cheapest is the RTX PRO 6000 (96 GB) at $1.80 per GPU-hour on Nebius (on-demand), verified 2026-07-08.
How many GPUs have at least 96 GB of VRAM?
5 GPU models in our index have at least 96 GB of VRAM.
Other sizes: 16 GB+ · 24 GB+ · 32 GB+ · 48 GB+ · 80 GB+ · 96 GB+ · 140 GB+ · 192 GB+ · all GPUs · full table.