GPU Rental Prices
SearchCtrl K
answered with live data · checked 21 November 2026

How much does it cost to train an LLM?

Training cost is the number of GPU hours you need multiplied by the hourly rate per GPU. Fine-tuning a small model can be a handful of GPU hours, while training a frontier model from scratch runs into millions of GPU hours across thousands of cards. The cheapest verified H100 in our index is $1.80/hr, which is the number you would plug in for a Hopper-class training run.

In our latest check: A run of 10,000 H100 GPU-hours costs $18,000 at the cheapest on-demand rate (HyperAI) and $34,300 at the median provider's rate, so the choice of provider alone moves the bill by $16,300.

The cheapest on-demand H100 offers, per GPU-hour. Spot, community and marketplace-host offers are listed on the H100 page.

GPUVRAM$/GPU-hrWhere
H100 PCIe80 GB$1.80HyperAI on-demandRent →
H10080 GB$1.99Voltage Park on-demandRent →
H100 SXM80 GB$2.25TensorDock on-demandRent →
H10080 GB$2.39Spheron on-demandRent →
H10080 GB$2.50Hyperstack on-demandRent →
H10080 GB$2.60GMI Cloud on-demandRent →
H10080 GB$2.73Massed Compute on-demandRent →
H10080 GB$2.85Runcrate on-demandRent →
Cite this data

GPU Rental Prices, "How Much Does It Cost to Train an LLM?", prices checked 21 November 2026, https://gpurentalprices.com/answers/how-much-does-it-cost-to-train-an-llm

Quote it with a link to this page. Downloads of the whole dataset are on Data & API.

For a concrete estimate, start with the compute the run needs and the throughput of your GPU, then divide to get GPU hours. Multiply those GPU hours by the hourly rate per GPU. If you think in wall-clock time instead, multiply the hours the run takes by the number of GPUs and by the rate: eight GPUs for 10 hours are 80 GPU hours either way, so count the GPUs only once. A short fine-tune of a 7B model might take tens of GPU hours; a full pretraining run of a mid-sized model takes tens of thousands.

The hourly rate is where a price index pays off, because the same H100 hour can differ several times over between a hyperscaler and a community tier. Spot instances cut the rate further if your training checkpoints often enough to survive interruptions.

Do not forget the costs around the GPUs: storage for datasets and checkpoints, egress if you move data out, and the wall-clock overhead of failed runs and restarts. Those are easy to underestimate and can rival the raw compute bill on a long project.

Related GPUs

H100 rental prices · H100 vs A100 · H100 vs H200

Related questions

Numbers on this page come from our verified snapshot of 21 November 2026. Full table on the homepage; method in the methodology.

Compare your offers

Saved prices keep their original dates. Confirm the configuration, terms and availability at the source.

Select up to three offers to compare their rates and terms.

Type a GPU, a provider, a model or a question.