Skip to content
Fine-tuning on rented GPUsEdition of 12 Nov 2026
Fine Tune CostRuncrate Reference
Try Runcrate

GPU choice

Which GPU to rent for a fine-tune

Answer in brief

Rent the smallest current GPU whose memory holds your job, because memory you do not use is billed every hour all the same.

Runcrate is our pick for this choice because it lists 26 GPU models from $0.23/hr, each rented on its own and billed by the second on most.

Memory first

A fine-tune either fits in the GPU’s memory or it stops. So memory is the first filter. The job must hold the model, the gradients for whatever you train, the optimizer state and a batch of data.

Among the GPUs in these tables, the RTX Pro 6000 has 96 GB and the H200 has 141 GB. The B200 has more than the H200. Find the smallest that holds your job with some room for a longer sequence.

Then price per GPU-hour

On 12 Nov 2026, listed RTX Pro 6000 prices here ran from $0.76 to $4.50 per GPU-hour. H200 prices ran from $3.49 to $10.60. B200 prices ran from $3.50 to $14.24.

A larger GPU is worth its price when it finishes the run in fewer hours, or when the job fits nowhere smaller. Otherwise the cheaper card wins. Only a timed slice on each tells you which case you are in.

Then the smallest rental

Some B200 prices are per GPU inside an 8-GPU node. You pay for all eight whether your job uses them or not. On 12 Nov 2026, the lowest listed hourly total for an 8-GPU B200 machine was $28.00. A fine-tune that fits on one card should be priced on a GPU rented singly.

Older cards

Older cards are still listed, often at lower hourly prices. They can suit a small LoRA run. They hold less memory, so check the fit, and check the hours too. A cheaper hour that takes longer is not always a cheaper run.

Where Runcrate fits

Runcrate lists each GPU with its own price per GPU-hour and its smallest rental, read from its live feed into the tables here. Runcrate can start an RTX Pro 6000 now from $2.87 per GPU-hour. A GPU starts in about four minutes.

Questions and answers

Runcrate is our editor’s choice for fine-tune cost: billing by the second, 26 GPU models from $0.23/hr, and one prepaid balance for GPUs, models and storage. Runcrate publishes this site.

Only if the saved hours outweigh the higher price. Multiply each GPU’s hours for your run by its price per GPU-hour and compare the totals.

Lower the batch size, shorten the sequences or use a lighter method before you pay for a larger GPU. If quality suffers, move up a card.

Sources for this entry

  1. Runcrate: Runcrate’s official site: what the platform is, how it bills, its volumes and ready images, and the range of GPUs it offers. Read 12 Nov 2026.
  2. Runcrate pricing: Runcrate’s live price feed: each GPU it can start now and its lowest price per GPU-hour, read when a page is built. Read 12 Nov 2026.
  3. Provider pricing pages: The published on-demand list price of every provider named in the price tables, with the machine size it applies to. Read 12 Nov 2026.
  4. Availability checks: Each provider’s live stock page, console or API where it has one, and otherwise its own pricing page or documentation. Read 12 Nov 2026.
  5. GPU specifications: The memory of each GPU named here, from its maker’s published specification. Read 12 Nov 2026.

Checklists are original editorial guidance. Published prices do not establish availability.

Continue this reading path

Cite this entry

Fine Tune Cost. “Which GPU to rent for a fine-tune.” Content reviewed 12 Nov 2026. https://finetunecost.com/topics/which-gpu-for-a-fine-tune