A100 vs MI300X
A100 starts at $0.89/GPU-hour on-demand; MI300X starts at $2.39/GPU-hour on-demand. Compare the exact variants, memory and published specifications below. Peak compute figures do not establish application speed.
A100
MI300X
Spec sheet
| A100 | MI300X | |
|---|---|---|
| Spec variant | A100 SXM 40GB | MI300X |
| Architecture | Ampere | CDNA 3 |
| VRAM (spec variant) | 40 GB | 192 GB |
| FP16 TFLOPS (dense) | 312 | 1307 |
| Memory bandwidth | 1555 GB/s | 5300 GB/s |
| TDP | 400 W | 750 W |
| Interconnect | NVLink 600GB/s | Infinity Fabric |
| Launched | 2020 | 2023 |
Rental price per manufacturer-rated FP16 compute: A100 $2.85 per PFLOP-hour vs MI300X $1.83. Formula: cheapest $/hr ÷ dense FP16 PFLOPS (1 PFLOP = 1000 TFLOPS). This uses A100 SXM 40GB and MI300X, whose datasheets may differ from the variants above. It is not measured job throughput. Specs: A100 manufacturer, MI300X manufacturer.
What they cost to rent (2026-10-02)
| A100 | MI300X | |
|---|---|---|
| Cheapest on-demand $/hr | $0.89 | $2.39 |
| Cheapest spot/community $/hr | $0.679 | – |
| Cheapest source | Jarvislabs | RunPod |
| Providers offering it | 21 | 5 |
Lowest recorded on-demand rate per configuration; highlighted = cheaper. Spot/marketplace tiers shown on the individual pages.
FAQ
A100 is cheaper: the A100 rents from $0.89 per GPU-hour and the MI300X from $2.39 on-demand, updated 2026-10-02.
The largest recorded A100 variant has 80 GB and the largest MI300X variant has 192 GB. Other variants may have less memory. The MI300X has more.
Compare more rental options: the screener · price movers · methodology.