GPU Rental Prices
SearchCtrl K

Kimi K2 VRAM requirements

Kimi K2 has 1,026.41 billion parameters in its published weight files. At 4 bits, the weights alone need approximately 513.2 GB. A full inference estimate is unavailable because the published configuration is restricted or uses an attention layout this calculator does not model.

Moonshot AI's model card gives 1 trillion total parameters with 32B activated. The weights are published in FP8, so the 8-bit row is closest to the published files. Read the model card.

Checked 21 November 2026. Memory estimates use decimal GB. Quantized weights may add scales, metadata and buffers; a compatible implementation and model licence are still required.

Change the memory assumptions

Weights only
513.2GB
Weights 513.2 GB · cache not modelled · headroom not modelled.

Full inference not modelled; no GPU fit is claimed.

Memory at different precisions

PrecisionWeights GBInference GBLoRA scenario GBFull fine-tune GB
16-bit2,052.8Not modelled2,239.618,477
8-bit1,026.4Not modelled1,213.218,477
4-bit513.2Not modelled700.018,477

How the estimate is calculated

Weights = parameters × bits ÷ 8. For supported standard attention, KV cache = 2 × layers × KV heads × head dimension × context tokens × batch size × 2 bytes. Inference adds the chosen percentage of runtime headroom to weights and cache. Divide bytes by 1,000,000,000 for GB.

The LoRA scenario keeps the chosen base weights and allows 18 bytes per trainable adapter parameter, plus the activation allowance. Full fine-tuning uses 18 bytes per parameter for a mixed-precision AdamW scenario, plus that allowance. Its total does not fall when you select 4-bit inference weights. These are budget estimates, not measured memory peaks; training context, optimizer, checkpointing and implementation can change them substantially.

Single-GPU candidates for this inference scenario

The offers update with the memory inputs above. Availability not reported means stock has not been confirmed. Memory capacity alone does not establish runtime compatibility or speed.

No GPU recommendation is made without a supported full memory estimate. Compare GPU memory and rental rates.

Price a training run of Kimi K2 and check it fits the node · Compare an API bill with self-hosting

Other models from this publisher

Compare your offers

Saved prices keep their original dates. Confirm the configuration, terms and availability at the source.

Select up to three offers to compare their rates and terms.

Type a GPU, a provider, a model or a question.