Skip to main content
Fireworks Serverless offers three modes:
  • Standard is the default mode. No service_tier parameter is needed.
  • Priority tier is for workloads that require higher reliability during peak traffic.
  • Fast is for workloads that require higher speeds.

Priority tier

Priority tier is for workloads that require higher reliability during peak traffic periods, at a higher price point. Priority tier is prioritized above Standard traffic and is less likely to be load shed (503 server overloaded). To use priority tier, set service_tier to "priority". Supported on OpenAI-compatible chat completions and on the Anthropic-compatible messages API:
Priority tier is available on select models. Models and pricing are listed on the Serverless pricing page.

Fast

Fast is a high-speed mode, useful for interactive applications that require fast response speeds, at a higher price point. Fast variants aim for 100+ tokens per second of generated throughput. It is not a different model and the quality of the model remains the same. Fast is available for select models. To use Fast, change the model ID as listed below. For the US-only Fast variant, call https://us.api.fireworks.ai. See US-only Serverless.
Pricing is listed on the Serverless pricing page.