How much does it cost to train an LLM?
Training cost is the number of GPU hours you need multiplied by the hourly rate per GPU. Fine-tuning a small model can be a handful of GPU hours, while training a frontier model from scratch runs into millions of GPU hours across thousands of cards. The cheapest verified H100 in our index is $1.80/hr, which is the number you would plug in for a Hopper-class training run.
In our latest check: A run of 10,000 H100 GPU-hours costs $18,000 at the cheapest on-demand rate (HyperAI) and $34,300 at the median provider's rate, so the choice of provider alone moves the bill by $16,300.
The cheapest on-demand H100 offers, per GPU-hour. Spot, community and marketplace-host offers are listed on the H100 page.
| GPU | VRAM | $/GPU-hr | Where | |
|---|---|---|---|---|
| H100 PCIe | 80 GB | $1.80 | HyperAI on-demand | Rent → |
| H100 | 80 GB | $1.99 | Voltage Park on-demand | Rent → |
| H100 SXM | 80 GB | $2.25 | TensorDock on-demand | Rent → |
| H100 | 80 GB | $2.39 | Spheron on-demand | Rent → |
| H100 | 80 GB | $2.50 | Hyperstack on-demand | Rent → |
| H100 | 80 GB | $2.60 | GMI Cloud on-demand | Rent → |
| H100 | 80 GB | $2.73 | Massed Compute on-demand | Rent → |
| H100 | 80 GB | $2.85 | Runcrate on-demand | Rent → |
Cite this data
GPU Rental Prices, "How Much Does It Cost to Train an LLM?", prices checked 21 November 2026, https://gpurentalprices.com/answers/how-much-does-it-cost-to-train-an-llm
Quote it with a link to this page. Downloads of the whole dataset are on Data & API.
For a concrete estimate, start with the compute the run needs and the throughput of your GPU, then divide to get GPU hours. Multiply those GPU hours by the hourly rate per GPU. If you think in wall-clock time instead, multiply the hours the run takes by the number of GPUs and by the rate: eight GPUs for 10 hours are 80 GPU hours either way, so count the GPUs only once. A short fine-tune of a 7B model might take tens of GPU hours; a full pretraining run of a mid-sized model takes tens of thousands.
The hourly rate is where a price index pays off, because the same H100 hour can differ several times over between a hyperscaler and a community tier. Spot instances cut the rate further if your training checkpoints often enough to survive interruptions.
Do not forget the costs around the GPUs: storage for datasets and checkpoints, egress if you move data out, and the wall-clock overhead of failed runs and restarts. Those are easy to underestimate and can rival the raw compute bill on a long project.
Related GPUs
H100 rental prices · H100 vs A100 · H100 vs H200
Related questions
- How much does an H100 cost per hour?
- How does multi-GPU node pricing work?
- Is renting a GPU cheaper than buying one?
Numbers on this page come from our verified snapshot of 21 November 2026. Full table on the homepage; method in the methodology.