Skip to main content
Fireworks supports RFT training on warm start and already-fine-tuned models. Upload models to Fireworks and use the warm start option to continue training (e.g. from an SFT LoRA) with RFT, rather than start from scratch with a base model.

​
When to use warm start

Use the --warm-start-from flag when you want to:
  • Start RFT from an SFT model you’ve trained with Fireworks
  • Continue training from an existing fine-tuned LoRA adapter you’ve uploaded to Fireworks

​
Basic usage

When using --warm-start-from, do NOT include --base-model. The base model is automatically determined from the LoRA adapter.

​
SFT to RFT workflow

1

Create or upload SFT model

Get started with supervised fine-tuning on Fireworks:
Or if you already have a LoRA adapter, upload it to Fireworks:
Learn more about uploading custom LoRA adapters in the Custom Models guide.
2

Start RFT from SFT model

Use an existing model as a starting point, and combine with standard RFT parameters.

​
Troubleshooting

This means you specified both --base-model and --warm-start-from. Remove the --base-model flag.
Verify the model exists in your account: