​
Deployment costs

Q: Are there costs associated with deploying fine-tuned models to serverless infrastructure?

No, deploying fine-tuned models to serverless infrastructure is free.

What’s free:

  • Deploying fine-tuned models to serverless
  • Hosting models on serverless infrastructure
  • Deploying up to 100 fine-tuned models

What you pay for:

  • Usage costs on a per-token basis when the model is actually used
  • The fine-tuning process itself, if applicable

Note: This differs from on-demand deployments, which include hourly hosting costs.

​
Model availability

Q: Do you provide notice before removing model availability?

Yes, we provide advance notice before removing models from the serverless infrastructure:

  • Minimum 2 weeks’ notice before model removal
  • Longer notice periods may be provided for popular models, depending on usage
  • Higher-usage models may have extended deprecation timelines

Best Practices:

  1. Monitor announcements regularly.
  2. Prepare a migration plan in advance.
  3. Test alternative models to ensure continuity.
  4. Keep your contact information updated for timely notifications.

​
Additional resources