Skip to main content

Documentation Index

Fetch the complete documentation index at: https://docs.fireworks.ai/llms.txt

Use this file to discover all available pages before exploring further.

When you have multiple deployments of the same model, queries using just the model name (without #<DEPLOYMENT_NAME>) are routed to the “default” deployment.

​
Viewing the default deployment

Check which deployment is currently set as default: 
firectl model get <MODEL_NAME>
Look for Default: true in the output.

​
Setting a default deployment

Make a specific deployment the default for a model: 
firectl deployed-model update <DEPLOYED_MODEL_ID> --default

​
Use cases

Default deployments are useful when:
  • Testing new configurations – Keep production as default while testing a new deployment
  • Gradual rollouts – Switch default after validating a new deployment
  • A/B testing – Route specific traffic to non-default deployments

​
Important notes

You cannot delete a default deployment. First set a different deployment as default, or delete all other deployments for that model.
For more control over traffic routing, explicitly specify the deployment name in your queries: <DEPLOYMENT_NAME>