- Portability first: can your tuned model leave?
- Where it runs: hosted, cloud or local
- Hosted tuning and serving
- GPU and compute clouds
- Local and open-source training
- The eight platforms, A to Z
- Before any trial: your data and an evaluation set
- My advice on choosing where to fine-tune
- A one-evening trial plan
- Frequently asked questions
The right fine-tuning platform is one that lets you take your tuned model with you. Choose by where training runs: a hosted tuning service, a GPU or compute cloud, or your own hardware with open-source tools. Then check that you can export the trained weights and run them somewhere else before you upload a single row of data.
Can you take what you train somewhere else? Ask that before you compare a single feature, because a tuned model is only as safe as your ability to move it. Below are eight ways to fine-tune open models, in no particular order, grouped by where the training runs: hosted services, GPU and compute clouds, and your own machine.
Portability first: can your tuned model leave?
OpenAI's own model optimisation guide, in its developer documentation, says it's winding down its fine-tuning platform. It's closed to new users, existing users can still create training jobs for a while, and models that have already been tuned stay available for inference until their base models are deprecated.
That's an orderly notice, and it's still a clear reminder. A tuned model that lives only inside someone else's platform has a shelf life you don't control. When the base model goes, the tuned version goes with it, along with the work and data you put in.
So the first questions for any fine-tuning platform are about leaving, not joining:
- Can you download the trained weights, or adapter files, in a standard format?
- Is the base model open, so you could load the same weights with another provider or on your own machine?
- What happens to your tuned models if the vendor retires a base model or changes course?
- Can you keep your training data and evaluation set outside the platform?
Open base models make this much easier. If you tune an open model and keep the weights, a move means re-pointing where you serve it, not starting again.
Where it runs: hosted, cloud or local
| Tool | Where training runs | Good for |
|---|---|---|
| Anyscale | GPU and compute cloud (Ray) | Ray-based training and deployment on any cloud |
| Fireworks AI | Hosted training and inference | Turning open models into specialised ones |
| Hugging Face AutoTrain | Hosted, no-code training | Models trained without writing any training code |
| Lightning AI | GPU cloud | On-demand GPUs and clusters for your own models |
| Modal | Serverless GPU compute | Developing, training and serving AI apps at scale |
| Replicate | Hosted serving for custom models | Running open models and custom models by API |
| Together AI | Hosted tuning and serving | Inference, fine-tuning and GPU clusters in one place |
| Unsloth | Local, open source | Training on your own hardware with a desktop UI |
Hosted tuning and serving
Hosted services are the quickest route from a dataset to a working model, because someone else runs the machines and the training loop. Fireworks AI offers training and inference for turning open models into specialised ones. Hugging Face AutoTrain handles automatic training and fast deployment without training code, which helps if you'd rather fill in a form than write a script. Together AI combines inference, fine-tuning and GPU clusters on one platform.
Replicate sits slightly to the side. It runs open-source models through a cloud API and lets you deploy your own custom models packaged with Cog, its open-source tool, so think of it as a place to serve weights you've trained rather than a tuning service in its own description.
With every hosted option, ask the portability questions above and get the answers before your trial starts, not after your data is in.
GPU and compute clouds
Here you bring the training code and the cloud brings the hardware. Anyscale is built on open-source Ray for data-intensive workloads and, by the vendor's account, runs on any cloud. Lightning AI is a cloud for building, training and deploying your own models, with on-demand GPUs and clusters. Modal provides cloud infrastructure to develop, train and serve AI applications, and says it's built to work with open-source frameworks.
Because you write and own the training script, portability is mostly in your hands: the weights land wherever you save them. The work is yours too. Someone on the team needs to choose the method, set up the runs and watch them, so this group suits developers who are comfortable with Python and the usual open-source training libraries.
Local and open-source training
Unsloth is the one option here that runs on your own hardware: an open-source, no-code desktop UI for training and running open models, which the vendor says keeps training data on your machine. That's the most direct answer to the portability question, because nothing leaves your desk unless you send it.
The limit is the machine in front of you. Local training suits smaller models, experiments and data that can't leave the building. Bigger runs will push you to one of the clouds above, and the same open weights can follow you there.
The eight platforms, A to Z
Anyscale
Best for: Teams already working with Ray who want a platform for data-intensive workloads that build and deploy foundation models, which the vendor says runs on any cloud.
Fireworks AI
Best for: Developers who want hosted training and inference to turn an open model into a specialised one, which the vendor pitches as going beyond frontier models.
Hugging Face AutoTrain
Best for: People already in the Hugging Face ecosystem who want automatic training and fast deployment without writing training code, as the vendor describes it.
Lightning AI
Best for: PyTorch developers building, training and deploying their own models with on-demand GPUs and clusters; its free tier lists 50 free GPU hours (vendor page, as of Nov 2026).
Modal
Best for: Teams that develop, train and serve AI applications at scale on cloud infrastructure the vendor says is built to work with open-source frameworks.
Want AI doing the heavy lifting in your marketing?
I build the systems that handle the boring 80 percent, so you get your week back. Done properly, with the human kept in.
Replicate
Best for: Developers who run open-source models through a cloud API and want to deploy their own custom models, packaged with an open-source packaging tool.
Together AI
Best for: Builders wanting inference, fine-tuning and GPU clusters together in one full-stack platform for running and tuning open models, per the vendor.
Unsloth
Best for: Anyone who'd rather train and run open models on their own hardware with an open-source, no-code desktop UI, so training data stays on their machine.
Before any trial: your data and an evaluation set
The platform matters less than what you feed it. Get these ready first, so every trial runs on the same footing:
- A clean training set in the format the platform asks for, with personal and confidential details removed.
- An evaluation set of real examples the model never sees during training, with the answers you'd accept.
- A baseline: the same evaluation run on the untuned base model, so you can tell whether tuning helped.
- A note of the base model, its licence and where the weights will live afterwards.
- A simple pass mark agreed with whoever will use the model day to day.
Without an evaluation set, you can't tell a better model from a merely different one. Keep it out of every platform's training data and score each trial against it.
My advice on choosing where to fine-tune
Start with an open base model and a platform that hands you the weights. That one choice keeps every other door open: you can tune on a hosted service now, move to a GPU cloud later, or bring the work in-house if it grows. If a platform can't tell you plainly how to export what you train, leave it off the shortlist, however good the demo looks.
Then match the group to your team. If nobody wants to write training code, a hosted or no-code service is the sensible start. If you've got engineers who already work in PyTorch or Ray, a compute cloud gives you more control. And if your data can't leave the building, train locally first. Once the model's tuned, my guides to AI inference platforms and cloud GPU providers cover where to run it.
A one-evening trial plan
- Pick one open base model and one small, clean dataset of real examples.
- Run your evaluation set on the untuned base model and save the scores.
- Start the same tuning job on a hosted service and on a compute cloud or your own machine.
- While the jobs run, read each platform's documentation on exporting weights and note the format.
- Score both tuned models on the same evaluation set and compare them with the baseline.
- Download the weights from each, load them somewhere else and run one test prompt.
If the weights won't leave, or the scores don't beat the baseline, you've learnt that in one evening rather than months into a project.
Do you make fine-tuning or model training tools? Tool makers can ask to be considered for a featured place on this list.
Want your tool on this list? Featured spots and reviews here are paid partnerships. Here's how to partner with me.
Frequently asked questions
What's the difference between fine-tuning and prompting?
Prompting changes what you ask a model each time. Fine-tuning trains the model on your own examples so the behaviour is built in, which helps when you need a consistent format, tone or task.
Can I move a fine-tuned model to another provider?
If you tuned an open base model and can download the weights or adapter files, usually yes. If the tuned model only lives inside one vendor's platform, you're tied to that vendor's plans for it.
Do I need my own GPUs to fine-tune a model?
No. Hosted services and GPU clouds run the training for you. Your own hardware is an option for smaller models, or when training data can't leave your machine.
How much data do I need to fine-tune?
There's no single answer; it depends on the model and the task. Start with a small, clean set of real examples, keep a separate evaluation set and check whether the tuned model beats the base model before adding more.
What's an evaluation set?
It's a group of real examples, with answers you'd accept, that the model never sees in training. You score the base model and each tuned version against it, so you know whether tuning helped.

