A100 SXM 40GB rental prices: cheapest $/hr today
The cheapest on-demand A100 SXM 40GB rental today is $0.89/hr on Jarvislabs, updated 2026-10-12. 40 GB VRAM, NVIDIA.
Spot from $0.738 (Microsoft Azure), can be interrupted
Pricing at a glance
All current A100 SXM 40GB offers
More filters: provider, memory, node size, stock, sort, price unit
| GPU / provider | Billing | $/GPU-hour | Node · total per hour | Rent |
|---|---|---|---|---|
| A100 SXM 40GB · Jarvislabs40 GB | on-demand | $0.89 | – | Rent → |
| A100 SXM 40GB · DataCrunch40 GB | on-demand | $1.41+9.6% in 30 days | 1× $1.41 | Rent → |
| A100 SXM 40GB · Lambda40 GB · ×2 listings | on-demand | $1.99 | 1× $1.99 | Rent →2026-10-12Details
|
| A100 SXM 40GB · AWS40 GB · p4d.24xlarge | on-demand | $2.74 | 8× $21.96 | Rent →2026-10-12Details
|
| A100 SXM 40GB · Google Cloud40 GB | on-demand | $2.93 | – | Rent →2026-10-12Details
|
| A100 SXM 40GB · Microsoft Azure40 GB · ×2 listings | on-demand | $3.40 | 8× $27.20 | Rent →2026-10-12Details
|
| A100 SXM 40GB · Microsoft Azure40 GB · Standard_ND96asr_v4 | spot / interruptible | $0.738 | 8× $5.90 | Rent →2026-10-12Details
|
| A100 SXM 40GB · Microsoft Azure40 GB · Standard_ND96asr_A100_v4 | spot / interruptible | $0.748 | 8× $5.98 | Rent →2026-10-12Details
|
| A100 SXM 40GB · RunPod40 GB | community cloud | $1.00 | – | Rent → |
| A100 SXM 40GB · AWS40 GB · p4d.24xlarge | spot / interruptible | $1.63 | 8× $13.07 | Rent →2026-10-12Details
|
| A100 SXM 40GB · Google Cloud40 GB | spot / interruptible | $1.76+3.9% in 30 days | – | Rent →2026-10-12Details
|
Try another provider or reduce the minimum memory.
Tables rank by price, lowest first. Commercial relationships never affect ordering. How we collect and rank prices.
Same GPU, provider, billing and price on several hosts or listings: one row, with the count. – means the provider does not state it.
Monthly view assumes 730 hours of continuous use. Daily view assumes 24 hours.
On-demand and secure-cloud rates are capacity the provider runs, with no reservation. Spot and community capacity can be interrupted. A marketplace host is one independent owner's server listed on a marketplace. Prices are per GPU per hour, before storage and data transfer. Every row shows the date it was checked.
A100 SXM 40GB hardware specs
| Architecture | Ampere |
|---|---|
| VRAM | 40 GB |
| FP16 TFLOPS (dense) | 312 |
| Memory bandwidth | 1555 GB/s |
| TDP | 400 W |
| Interconnect | NVLink 600GB/s |
| Launched | 2020 |
Datasheet spec for the A100 SXM 40GB variant. Source: www.nvidia.com.
Compare A100 SXM 40GB configurations
A100 SXM 40GB purchase prices · Rent or buy calculator · Compare two GPUs
- Microsoft Azure A100 SXM 40GB pricing
- Jarvislabs A100 SXM 40GB pricing
- RunPod A100 SXM 40GB pricing
- DataCrunch A100 SXM 40GB pricing
- AWS A100 SXM 40GB pricing
- Google Cloud A100 SXM 40GB pricing
- Lambda A100 SXM 40GB pricing
LLM memory estimates for this GPU
These models have an estimated inference footprint within 40 GB at one or more precisions. The scenario uses 4,096 tokens, batch 1, a 16-bit KV cache and 20% runtime headroom. A memory fit does not establish speed or software compatibility.
| Model | 16-bit GB | 8-bit GB | 4-bit GB |
|---|---|---|---|
| Mixtral 8x7B v0.1 | 112.7 | 56.7 | 28.7 ✓ |
| Qwen2.5 32B | 79.9 | 40.6 | 20.9 ✓ |
| Qwen2.5 Coder 32B | 79.9 | 40.6 | 20.9 ✓ |
| DeepSeek R1 Distill Qwen 32B | 79.9 | 40.6 | 20.9 ✓ |
| Qwen3 32B | 79.9 | 40.6 | 20.9 ✓ |
| Qwen3 30B A3B | 73.8 | 37.1 ✓ | 18.8 ✓ |
| Mistral Small 24B 2501 | 57.4 | 29.1 ✓ | 14.9 ✓ |
| Qwen2.5 14B | 36.4 ✓ | 18.7 ✓ | 9.8 ✓ |
| Qwen2.5 Coder 14B | 36.4 ✓ | 18.7 ✓ | 9.8 ✓ |
| DeepSeek R1 Distill Qwen 14B | 36.4 ✓ | 18.7 ✓ | 9.8 ✓ |
| Qwen3 14B | 36.2 ✓ | 18.5 ✓ | 9.7 ✓ |
| phi 4 | 36.2 ✓ | 18.6 ✓ | 9.8 ✓ |
| Mistral Nemo 2407 | 30.2 ✓ | 15.5 ✓ | 8.2 ✓ |
| Qwen3 8B | 20.4 ✓ | 10.6 ✓ | 5.6 ✓ |
| DeepSeek R1 Distill Llama 8B | 19.9 ✓ | 10.3 ✓ | 5.5 ✓ |
| Qwen2.5 7B | 18.6 ✓ | 9.4 ✓ | 4.9 ✓ |
| Qwen2.5 Coder 7B | 18.6 ✓ | 9.4 ✓ | 4.9 ✓ |
| DeepSeek R1 Distill Qwen 7B | 18.6 ✓ | 9.4 ✓ | 4.9 ✓ |
| Mistral 7B v0.3 | 18.0 ✓ | 9.3 ✓ | 5.0 ✓ |
| Qwen3 4B | 10.4 ✓ | 5.6 ✓ | 3.1 ✓ |
| Qwen2.5 3B | 7.6 ✓ | 3.9 ✓ | 2.0 ✓ |
| Qwen2.5 Coder 3B | 7.6 ✓ | 3.9 ✓ | 2.0 ✓ |
| Qwen3 1.7B | 5.4 ✓ | 3.0 ✓ | 1.8 ✓ |
| DeepSeek R1 Distill Qwen 1.5B | 4.4 ✓ | 2.3 ✓ | 1.2 ✓ |
| Qwen2.5 1.5B | 3.8 ✓ | 2.0 ✓ | 1.1 ✓ |
| Qwen2.5 Coder 1.5B | 3.8 ✓ | 2.0 ✓ | 1.1 ✓ |
| Qwen3 0.6B | 2.4 ✓ | 1.5 ✓ | 1.0 ✓ |
| Qwen2.5 0.5B | 1.2 ✓ | 0.7 ✓ | 0.4 ✓ |
| Qwen2.5 Coder 0.5B | 1.2 ✓ | 0.7 ✓ | 0.4 ✓ |
Compare model memory requirements or change context and memory assumptions on a model's page.
When to choose A100 SXM 40GB
Use the model memory estimates above to check whether your weights, context and batch size fit within 40 GB. Then compare the exact variant, node size and software support. Capacity alone does not establish inference speed or training throughput.
If your workload fits within 32 GB, compare RTX PRO 4500 rental prices from $0.72/GPU-hour. The smaller memory budget is the trade-off; price alone does not make the cards interchangeable.
A100 SXM 40GB price changes
- 30 days: 3.1% across 3 matching firm-price configurations since 2026-09-12.
- 90 days: 4.7% across 2 matching firm-price configurations since 2026-07-14.
Changes use the geometric mean of price ratios for the same provider, variant, tier, GPU count, instance and region. New listings are not counted as price changes.
Price history
on-demand rate per day, since 2026-07-06: $0.89 low · $0.89 high. Full ledger on the history hub.
FAQ
The cheapest A100 SXM 40GB rental we have is $0.89 per GPU-hour on Jarvislabs (on-demand), updated 2026-10-12.
40 GB.
Jarvislabs has the cheapest verified on-demand rate today at $0.89 per GPU-hour; interruptible spot/community capacity starts at $0.738. Verified 2026-10-12.
Related
All 24 GB+ GPUs · GPUs under $1/hr · Price movers this week · Jarvislabs review
Should you rent or buy?
Compare A100 SXM 40GB purchase prices and quote availability, then enter your usage and electricity costs in the rent-versus-buy calculator. Purchase listings have their own variants, stock status and update dates.