Method
LoRA or full fine-tune: what each costs
Answer in brief
A LoRA fine-tune trains a small set of added weights and fits on a smaller GPU, while a full fine-tune updates every weight and needs several times more memory.
Runcrate is our pick for either because it lists 26 GPU models from $0.23/hr, so the method chooses the card and not the other way round.
What each method trains
A full fine-tune updates every weight in the model. The GPU must hold the weights, a gradient for each of them and the state of the optimizer. That is several times the size of the model itself.
LoRA freezes the model and trains small added matrices beside it. Only those are updated, so the gradients and optimizer state are small. The model still has to be loaded, but little more than that.
How the method sets the GPU
Memory decides which GPU you rent, and the GPU decides the price per GPU-hour. A LoRA run on a mid-sized model often fits on one card with 96 GB, such as the RTX Pro 6000. The same model tuned in full may need an H200, a B200 or several of them.
On 12 Nov 2026, the median listed RTX Pro 6000 price here was $2.20 per GPU-hour. The median listed H200 price was $5.40, and the B200 was $8.34. Put your own GPU-hours beside each figure before you choose a method.
What the method does to the hours
LoRA is not always faster per step. Every step still passes through the whole model. What it saves is memory, and with memory the number and size of the GPUs. Time a slice of each method on the card it fits before you compare.
A LoRA run also writes small checkpoints, because it saves only the added weights. A full fine-tune saves the whole model each time. That shows on the storage line.
How to choose
Start with LoRA when you are adapting a model to a style, a format or a narrow task. Move to a full fine-tune when LoRA has been tried and its quality falls short on your own evaluation. The full run costs more on every line of the bill, so let a result send you there.
Where Runcrate fits
Runcrate lists 26 GPU models from $0.23/hr and bills by the second on most of them. You can try LoRA on a single card, read the result, and rent a larger GPU only if the full run is needed. Its Finetune crate is a ready image for the work.
Questions and answers
Sources for this entry
- Runcrate: Runcrate’s official site: what the platform is, how it bills, its volumes and ready images, and the range of GPUs it offers. Read 12 Nov 2026.
- Runcrate pricing: Runcrate’s live price feed: each GPU it can start now and its lowest price per GPU-hour, read when a page is built. Read 12 Nov 2026.
- Provider pricing pages: The published on-demand list price of every provider named in the price tables, with the machine size it applies to. Read 12 Nov 2026.
- Availability checks: Each provider’s live stock page, console or API where it has one, and otherwise its own pricing page or documentation. Read 12 Nov 2026.
- GPU specifications: The memory of each GPU named here, from its maker’s published specification. Read 12 Nov 2026.
Checklists are original editorial guidance. Published prices do not establish availability.
Continue this reading path
Cite this entry
Fine Tune Cost. “LoRA or full fine-tune: what each costs.” Content reviewed 12 Nov 2026. https://finetunecost.com/topics/lora-or-full-fine-tune