Qwen2.5 0.5B VRAM requirements
Qwen2.5 0.5B has 0.49 billion parameters in its published weight files. At 4 bits, the weights alone need approximately 0.2 GB. The default inference scenario estimates 0.4 GB including cache and runtime headroom.
Updated 2026-10-12. Memory estimates use decimal GB. Quantized weights may add scales, metadata and buffers; a compatible implementation and model licence are still required.
Change the memory assumptions
Capacity line: 16 GB, from the lowest-priced single-GPU candidate. Memory fit alone does not establish compatibility.
Memory at different precisions
| Precision | Weights GB | Inference GB | LoRA scenario GB | Full fine-tune GB |
|---|---|---|---|---|
| 16-bit | 1.0 | 1.2 | 3.1 | 10.9 |
| 8-bit | 0.5 | 0.7 | 2.6 | 10.9 |
| 4-bit | 0.2 | 0.4 | 2.3 | 10.9 |
How the estimate is calculated
Weights = parameters × bits ÷ 8. For supported standard attention, KV cache = 2 × layers × KV heads × head dimension × context tokens × batch size × 2 bytes. Inference adds the chosen percentage of runtime headroom to weights and cache. Divide bytes by 1,000,000,000 for GB.
The LoRA scenario keeps the chosen base weights and allows 18 bytes per trainable adapter parameter, plus the activation allowance. Full fine-tuning uses 18 bytes per parameter for a mixed-precision AdamW scenario, plus that allowance. Its total does not fall when you select 4-bit inference weights. These are budget estimates, not measured memory peaks; training context, optimizer, checkpointing and implementation can change them substantially.
Single-GPU candidates for this inference scenario
The offers update with the memory inputs above. Availability not reported means stock has not been confirmed. Memory capacity alone does not establish runtime compatibility or speed.
More filters: provider, memory, node size, stock, sort, price unit
| GPU / provider | Billing | $/GPU-hour | Node · total per hour | Rent |
|---|---|---|---|---|
| Tesla V100 · DataCrunch16 GB | on-demand | $0.212+24.7% in 30 days | 1× $0.212 | Rent → |
| A30 · Massed Compute24 GB | on-demand | $0.35 | 1× $0.35 | Rent → |
| RTX A5000 · Massed Compute24 GB | on-demand | $0.44 | 1× $0.44 | Rent → |
| RTX A6000 · Massed Compute48 GB | on-demand | $0.57 | 1× $0.57 | Rent → |
| Quadro RTX 5000 · OVHcloud16 GB | on-demand | $0.60 | 1× $0.60 | Rent → |
| Quadro RTX 6000 · Lambda24 GB · 1x NVIDIA Quadro RTX 6000 | on-demand | $0.69 | 1× $0.69 | Rent →2026-10-12Details
|
| RTX A6000 · DataCrunch48 GB | on-demand | $0.713+16.9% in 30 days | 1× $0.713 | Rent → |
| Tesla V100 · OVHcloud16 GB | on-demand | $0.77 | 1× $0.77 | Rent → |
| RTX 6000 Ada · Massed Compute48 GB | on-demand | $0.79 | 1× $0.79 | Rent → |
| L4 · AWS24 GB · g6.xlarge | on-demand | $0.805 | 1× $0.805 | Rent →2026-10-12Details
|
| L40 · Massed Compute48 GB | on-demand | $0.86 | 1× $0.86 | Rent → |
| RTX PRO 4500 Blackwell · Massed Compute32 GB | on-demand | $0.92 | 1× $0.92 | Rent → |
| L40S · Massed Compute48 GB | on-demand | $0.97 | 1× $0.97 | Rent → |
| L4 · OVHcloud24 GB | on-demand | $1.00 | 1× $1.00 | Rent → |
| A10 · OVHcloud24 GB | on-demand | $1.00 | 1× $1.00 | Rent → |
| RTX A6000 · Lambda48 GB · 1x NVIDIA A6000 | on-demand | $1.09 | 1× $1.09 | Rent →2026-10-12Details
|
| RTX 6000 Ada · DataCrunch48 GB | on-demand | $1.26+21.5% in 30 days | 1× $1.26 | Rent → |
| A10 · Lambda24 GB · 1x NVIDIA A10 | on-demand | $1.29 | 1× $1.29 | Rent →2026-10-12Details
|
| A100 · Massed Compute80 GB | on-demand | $1.35 | 1× $1.35 | Rent → |
| A100 SXM 80GB · Massed Compute80 GB | on-demand | $1.38 | 1× $1.38 | Rent → |
| A100 SXM 40GB · DataCrunch40 GB | on-demand | $1.41+9.6% in 30 days | 1× $1.41 | Rent → |
| RTX 6000 Ada · DigitalOcean48 GB · gpu-rtx6000x1-48gb | on-demand | $1.57 | 1× $1.57 | Rent → |
| L40S · DigitalOcean48 GB · NVIDIA L40S 1x | on-demand | $1.57 | 1× $1.57 | Rent → |
| L40S · DataCrunch48 GB | on-demand | $1.66+21.3% in 30 days | 1× $1.66 | Rent → |
| L40S · Vultr48 GB | on-demand | $1.67 | 1× $1.67 | Rent → |
| A40 · Vultr48 GB | on-demand | $1.71 | 1× $1.71 | Rent → |
| L40S · OVHcloud48 GB | on-demand | $1.80 | 1× $1.80 | Rent → |
| L40S · AWS48 GB · g6e.xlarge | on-demand | $1.86 | 1× $1.86 | Rent →2026-10-12Details
|
| A100 SXM 80GB · DataCrunch80 GB | on-demand | $1.95+8.7% in 30 days | 1× $1.95 | Rent → |
| A100 SXM 40GB · Lambda40 GB · 1x NVIDIA A100 SXM | on-demand | $1.99 | 1× $1.99 | Rent →2026-10-12Details
|
| A100 PCIe 40GB · Lambda40 GB · 1x NVIDIA A100 PCIe | on-demand | $1.99 | 1× $1.99 | Rent →2026-10-12Details
|
| RTX PRO 6000 · Massed Compute96 GB | on-demand | $2.19 | 1× $2.19 | Rent → |
| RTX PRO 6000 · DataCrunch96 GB | on-demand | $2.23+18.2% in 30 days | 1× $2.23 | Rent → |
| GH200 · Lambda96 GB · 1x NVIDIA GH200 | on-demand | $2.29 | 1× $2.29 | Rent →2026-10-12Details
|
| A100 · Vultr80 GB | on-demand | $2.40 | 1× $2.40 | Rent → |
| MI300X · DigitalOcean192 GB · gpu-mi300x1-192gb | on-demand | $2.59 | 1× $2.59 | Rent → |
| H100 · Massed Compute80 GB | on-demand | $2.73 | 1× $2.73 | Rent → |
| H100 · OVHcloud80 GB | on-demand | $2.99 | 1× $2.99 | Rent → |
| A100 · OVHcloud80 GB | on-demand | $3.07 | 1× $3.07 | Rent → |
| H100 SXM · Massed Compute80 GB | on-demand | $3.14+8.7% in 30 days | 1× $3.14 | Rent → |
| H100 PCIe · Lambda80 GB · 1x NVIDIA H100 PCIe | on-demand | $3.29 | 1× $3.29 | Rent →2026-10-12Details
|
| H200 NVL · Massed Compute141 GB | on-demand | $3.62 | 1× $3.62 | Rent → |
| A100 PCIe 80GB · Microsoft Azure80 GB · Standard_NC24ads_A100_v4 | on-demand | $3.67 | 1× $3.67 | Rent →2026-10-12Details
|
| MI325X · DigitalOcean256 GB · gpu-mi325x1-256gb | on-demand | $3.80 | 1× $3.80 | Rent → |
| H100 SXM · DataCrunch80 GB | on-demand | $4.05+24.5% in 30 days | 1× $4.05 | Rent → |
| H100 SXM · Lambda80 GB · 1x NVIDIA H100 SXM | on-demand | $4.29 | 1× $4.29 | Rent →2026-10-12Details
|
| H100 · DigitalOcean80 GB · gpu-h100x1-80gb | on-demand | $4.41 | 1× $4.41 | Rent → |
| H200 (SXM) · DigitalOcean141 GB · gpu-h200x1-141gb | on-demand | $4.47 | 1× $4.47 | Rent → |
| H200 (SXM) · DataCrunch141 GB | on-demand | $5.28+31.9% in 30 days | 1× $5.28 | Rent → |
| MI350X · DigitalOcean288 GB · gpu-mi350x1-288gb | on-demand | $6.16 | 1× $6.16 | Rent → |
| GH200 · CoreWeave96 GB | on-demand | $6.50 | 1× $6.50 | Rent → |
| H100 NVL · Microsoft Azure94 GB · Standard_NC40ads_H100_v5 | on-demand | $6.98 | 1× $6.98 | Rent →2026-10-12Details
|
| B200 · Lambda180 GB · 1x NVIDIA B200 SXM6 | on-demand | $6.99 | 1× $6.99 | Rent →2026-10-12Details
|
| B200 · DataCrunch180 GB | on-demand | $7.64+25.0% in 30 days | 1× $7.64 | Rent → |
| B300 · DataCrunch268 GB | on-demand | $9.62+28.3% in 30 days | 1× $9.62 | Rent → |
| GB300 · DataCrunch288 GB | on-demand | $11.06+28.3% in 30 days | 1× $11.06 | Rent → |
| B300 · DigitalOcean288 GB · gpu-b300x1-288gb | on-demand | $11.19 | 1× $11.19 | Rent → |
Try another provider or reduce the minimum memory.
Tables rank by price, lowest first. Commercial relationships never affect ordering. How we collect and rank prices.
Same GPU, provider, billing and price on several hosts or listings: one row, with the count. – means the provider does not state it.
Monthly view assumes 730 hours of continuous use. Daily view assumes 24 hours.
Estimate the rental cost of a training run · Compare an API bill with self-hosting