What is the cheapest 24GB GPU to rent?
The 24GB class is the cheapest useful tier for AI work, led by consumer and workstation cards like the RTX 4090, RTX 3090, RTX A5000, and the datacenter L4. The cheapest verified 4090 in our index is $0.58/hr, and these cards routinely rent for well under a dollar an hour. For inference on models up to roughly 13B parameters, or 30B when quantized, a 24GB card is the practical value floor.
| GPU | VRAM | $/hr | Where | |
|---|---|---|---|---|
| RTX A5000 | 24 GB | $0.27 | RunPod secure cloud | Rent → |
| L4 | 24 GB | $0.39 | RunPod secure cloud | Rent → |
| A40 | 48 GB | $0.44 | RunPod secure cloud | Rent → |
| RTX 3090 | 24 GB | $0.46 | RunPod secure cloud | Rent → |
| RTX A6000 | 48 GB | $0.49 | RunPod secure cloud | Rent → |
| RTX 4090 | 24 GB | $0.58 | Spheron on-demand | Rent → |
| RTX 5090 | 32 GB | $0.68 | Spheron on-demand | Rent → |
| RTX 6000 Ada | 48 GB | $0.77 | RunPod secure cloud | Rent → |
| L40 | 48 GB | $0.82 | RunPod secure cloud | Rent → |
| L40S | 48 GB | $0.88 | Massed Compute on-demand | Rent → |
Twenty-four gigabytes is enough for a lot of real work: single-user LLM inference on small and mid-size models, Stable Diffusion and SDXL generation, LoRA training, and light fine-tuning. It is not enough to hold a 70B model at usable precision or to fully fine-tune large models, which is where 48GB and 80GB cards take over.
The cards in this tier differ in ways beyond price. The RTX 4090 is the fastest for most single-GPU tasks, the RTX 3090 trades a little speed for an even lower rate, and the L4 is a low-power datacenter card that some providers offer on more stable tiers. Pick on availability and reliability once the price is close.
The table below lists the 24GB-and-up cards we track, sorted by price, so you can see where each currently sits across providers. It is rebuilt from the daily snapshot rather than a fixed list price.
Related questions
- How much does an RTX 4090 cost to rent?
- What is the cheapest GPU for Stable Diffusion?
- Is 24GB of VRAM enough for running an LLM?
Numbers on this page come from today's verified snapshot. Full table on the homepage; method in the methodology.