Skip to main content
FireRouter is a managed routing service for any LLM workload. Request the FireRouter model through the Fireworks inference API, and FireRouter scores each turn to decide whether it can be served by a cheaper Fireworks open model or should pass through to a closed-source model. The result is lower cost on simpler requests without giving up closed-source quality on harder ones.
FireRouter is in research preview. APIs, routing behavior, and the models in the routing pair may change. This documentation is updated to reflect the current configuration.

​
When to use FireRouter

Use FireRouter when you want automatic cost optimization without picking a different model per request:
  • You want closed-source quality (for example Claude Opus) on hard prompts but do not need it on every call.
  • Many of your requests are straightforward (summaries, formatting, simple Q&A) and can be served by a Fireworks open model.
  • You are fine sending both a Fireworks API key and a provider API key on each request.

​
How it works

FireRouter scores each request independently and picks one of two paths: FireRouter uses a bring-your-own-key (BYOK) model:
  • Your Fireworks API key authenticates to FireRouter and pays for redirected calls.
  • Your provider API key pays for pass-through calls to closed-source models.
FireRouter never stores your provider keys server-side. You send them on each request.

​
Endpoint

FireRouter is available through the Fireworks inference API:
Common API paths:

​
Model ID

FireRouter is a first-party model on the Fireworks provider. Use firerouter in the model field:
These longer forms are also accepted:
For LiteLLM, use the full router path in litellm_params.model. FireRouter routes each request between a configured closed-source model and a Fireworks open model. You do not pick the target model per request; FireRouter decides based on request complexity.

​
Current routing pair

The FireRouter model currently routes between: These models are subject to change as FireRouter is updated. This page reflects the current configuration. Because the pass-through target is Claude Opus 4.8, you must supply an Anthropic API key. See Authentication.

​
Client integrations

​
What FireRouter is not

  • Not a deployment router. FireRouter is different from deployment routers, which load-balance traffic across your own Fireworks deployments.
  • Not request-sticky. Each request is scored independently.

​
Next steps

Quickstart

Make your first API call

Authentication

BYOK headers and API key requirements

Routing preferences

Tune the quality vs. savings dial

LiteLLM

Add FireRouter to LiteLLM Proxy

FireConnect

Connect coding harnesses to Fireworks