Deployment & Infrastructure
Are there costs associated with deploying fine-tuned models to serverless infrastructure?
No, deploying fine-tuned models to serverless infrastructure is free.
What’s free:
- Deploying fine-tuned models to serverless
- Hosting models on serverless infrastructure
- Deploying up to 100 fine-tuned models
What you pay for:
- Usage costs on a per-token basis when the model is actually used
- The fine-tuning process itself, if applicable
Note: This differs from on-demand deployments, which include hourly hosting costs.