Serverless API
Image Models
All image models deployed are accessible via Image Playground and the Serverless API. We offer on-demand deployments of image models if you have larger volume of traffic and need better response times.Image playgrounds of Stable Diffusion 3 Large (exclusive on Fireworks AI), Stable Diffusion Turbo and Stable Diffusion Medium need API key from Stability AI.
| Model Family | Model Name | Model ID for API |
|---|---|---|
| Stable Diffusion | SD3 | accounts/stability/models/sd3 |
| Stable Diffusion | SD3 Medium | accounts/stability/models/sd3-medium |
| Stable Diffusion | Stable Diffusion XL 1024 v1.0 | accounts/fireworks/models/stable-diffusion-xl-1024-v1-0 |
| Playground | Playground v2 1024px Aesthetic | accounts/fireworks/models/playground-v2-1024px-aesthetic |
| Playground | Playground v2.5 1024px Aesthetic | accounts/fireworks/models/playground-v2-5-1024px-aesthetic |
| Stable Diffusion | SSD-1B | accounts/fireworks/models/SSD-1B |
| Stable Diffusion | Japanese Stable Diffusion XL | accounts/fireworks/models/japanese-stable-diffusion-xl |
| Stable Diffusion | SD3 Turbo | accounts/stability/models/sd3-turbo |
Language Models
These models are already deployed and ready to be accessed from our Serverless API, pick up the appropriate model string from the table to starting making a API Request. You can refer the Querying Text Models guide for getting started.| Model Family | Model Name | Model ID for API |
|---|---|---|
| FireLLaVA | FireLLaVA-13B | accounts/fireworks/models/firellava-13b |
| FireFunction | FireFunction v1 | accounts/fireworks/models/firefunction-v1 |
| Mixtral | Mixtral 8x7B Instruct | accounts/fireworks/models/mixtral-8x7b-instruct |
| Llama | Llama v3 70B Instruct | accounts/fireworks/models/llama-v3-70b-instruct |
| Bleat | Bleat Adapter | accounts/fireworks/models/bleat-adapter |
| DBRX | DBRX Instruct | accounts/fireworks/models/dbrx-instruct |
| Gemma | Gemma 7B IT | accounts/fireworks/models/gemma-7b-it |
| Hermes | Hermes 2 Pro Mistral 7B | accounts/fireworks/models/hermes-2-pro-mistral-7b |
| Stable LM | Japanese Stable LM Instruct Beta 70B | accounts/stability/models/japanese-stablelm-instruct-beta-70b |
| Stable LM | Japanese Stable LM Instruct Gamma 7B | accounts/stability/models/japanese-stablelm-instruct-gamma-7b |
| Llama | Llama v2 13B | accounts/fireworks/models/llama-v2-13b |
| Llama | Llama v2 13B Chat | accounts/fireworks/models/llama-v2-13b-chat |
| Llama | Llama v2 34B Code Instruct | accounts/fireworks/models/llama-v2-34b-code-instruct |
| Llama | Llama v2 70B Chat | accounts/fireworks/models/llama-v2-70b-chat |
| Llama | Llama v2 7B | accounts/fireworks/models/llama-v2-7b |
| Llama | Llama v2 7B Chat | accounts/fireworks/models/llama-v2-7b-chat |
| Llama | Llama v3 70B Instruct HF | accounts/fireworks/models/llama-v3-70b-instruct-hf |
| Llama | Llama v3 8B HF | accounts/fireworks/models/llama-v3-8b-hf |
| Llama | Llama v3 8B Instruct | accounts/fireworks/models/llama-v3-8b-instruct |
| Llama | Llama v3 8B Instruct HF | accounts/fireworks/models/llama-v3-8b-instruct-hf |
| LLaVA | LLaVA Yi 34B | accounts/fireworks/models/llava-yi-34b |
| Mistral | Mistral 7B | accounts/fireworks/models/mistral-7b |
| Mistral | Mistral 7B Instruct 4K | accounts/fireworks/models/mistral-7b-instruct-4k |
| Mistral | Mistral 7B Instruct v0.2 | accounts/fireworks/models/mistral-7b-instruct-v0p2 |
| Mistral | Mistral 7B Instruct v3 | accounts/fireworks/models/mistral-7b-instruct-v3 |
| Mixtral | Mixtral 8x22B | accounts/fireworks/models/mixtral-8x22b |
| Mixtral | Mixtral 8x22B HF | accounts/fireworks/models/mixtral-8x22b-hf |
| Mixtral | Mixtral 8x22B Instruct HF | accounts/fireworks/models/mixtral-8x22b-instruct-hf |
| Mixtral | Mixtral 8x7B | accounts/fireworks/models/mixtral-8x7b |
| Mixtral | Mixtral 8x7B Instruct HF | accounts/fireworks/models/mixtral-8x7b-instruct-hf |
| MythoMax | MythoMax L2 13B | accounts/fireworks/models/mythomax-l2-13b |
| Nous Hermes | Nous Hermes 2 Mixtral 8x7B DPO FP8 | accounts/fireworks/models/nous-hermes-2-mixtral-8x7b-dpo-fp8 |
| Phi | Phi 3 Mini 128K Instruct | accounts/fireworks/models/phi-3-mini-128k-instruct |
| Phi | Phi 3 Vision 128K Instruct | accounts/fireworks/models/phi-3-vision-128k-instruct |
| Qwen | Qwen1.5 72B Chat | accounts/fireworks/models/qwen1p5-72b-chat |
| Qwen | Qwen2 72B Instruct | accounts/fireworks/models/qwen2-72b-instruct |
| Stable LM | Stable LM 2 Zephyr 2B | accounts/stability/models/stablelm-2-zephyr-2b |
| Stable LM | Stable LM Zephyr 3B | accounts/stability/models/stablelm-zephyr-3b |
Code Generation Models
| Model Family | Model Name | Model ID for API |
|---|---|---|
| StarCoder | StarCoder 16B | accounts/fireworks/models/starcoder-16b |
On-demand Models
Models that are available on platform to quickly deploy for inference on Fireworks AI API. To get started, you can refer the guide on on-demand deploymentsLanguage Models
| Model Family | Model Name | Model ID for API |
|---|---|---|
| Chronos | Chronos Hermes 13B v2 | accounts/fireworks/models/chronos-hermes-13b-v2 |
| DBRX | DBRX Instruct FP8 | accounts/fireworks/models/dbrx-instruct-fp8 |
| Qwen | Dolphin 2.9.2 Qwen2 72B | accounts/fireworks/models/dolphin-2-9-2-qwen2-72b |
| Mixtral | Dolphin 2.6 Mixtral 8x7B | accounts/fireworks/models/dolphin-2p6-mixtral-8x7b |
| Llama | ELYZA Japanese Llama 2 7B Fast Instruct | accounts/fireworks/models/elyza-japanese-llama-2-7b-fast-instruct |
| Gemma | Gemma 7B | accounts/fireworks/models/gemma-7b |
| Stable VLM | Japanese Stable VLM 8B | accounts/stability/models/japanese-stable-vlm-8b |
| Llama Guard | Llama Guard 2 8B | accounts/fireworks/models/llama-guard-2-8b |
| Llama Guard | Llama Guard 7B | accounts/fireworks/models/llamaguard-7b |
| Mistral | Mistral 7B v0.2 | accounts/fireworks/models/mistral-7b-v0p2 |
| Mixtral | Mixtral 8x22B Instruct | accounts/fireworks/models/mixtral-8x22b-instruct |
| Mixtral | Mixtral 8x22B Instruct Preview | accounts/fireworks/models/mixtral-8x22b-instruct-preview |
| Nous Capybara | Nous Capybara 7B v1.9 | accounts/fireworks/models/nous-capybara-7b-v1p9 |
| Nous Hermes | Nous Hermes 2 Mixtral 8x7B DPO | accounts/fireworks/models/nous-hermes-2-mixtral-8x7b-dpo |
| Nous Hermes | Nous Hermes 2 Yi 34B | accounts/fireworks/models/nous-hermes-2-yi-34b |
| Nous Hermes | Nous Hermes Llama2 13B | accounts/fireworks/models/nous-hermes-llama2-13b |
| Nous Hermes | Nous Hermes Llama2 70B | accounts/fireworks/models/nous-hermes-llama2-70b |
| Nous Hermes | Nous Hermes Llama2 7B | accounts/fireworks/models/nous-hermes-llama2-7b |
| OpenChat | OpenChat 3.5 0106 7B | accounts/fireworks/models/openchat-3p5-0106-7b |
| OpenHermes | OpenHermes 2 Mistral 7B | accounts/fireworks/models/openhermes-2-mistral-7b |
| OpenHermes | OpenHermes 2.5 Mistral 7B | accounts/fireworks/models/openhermes-2p5-mistral-7b |
| Mistral | OpenOrca 7B | accounts/fireworks/models/openorca-7b |
| Phi | Phi 2 3B | accounts/fireworks/models/phi-2-3b |
| Pythia | Pythia 12B | accounts/fireworks/models/pythia-12b |
| Qwen | Qwen 14B Chat | accounts/fireworks/models/qwen-14b-chat |
| Qwen | Qwen 72B Chat | accounts/fireworks/models/qwen-72b-chat |
| Snorkel | Snorkel Mistral 7B PairRM DPO | accounts/fireworks/models/snorkel-mistral-7b-pairrm-dpo |
Code Generation
| Model Family | Model Name | Model ID for API | |
|---|---|---|---|
| Code Llama | Code Llama 13B | accounts/fireworks/models/code-llama-13b | 32,768 |
| Code Llama | Code Llama 13B Instruct | accounts/fireworks/models/code-llama-13b-instruct | |
| Code Llama | Code Llama 13B Python | accounts/fireworks/models/code-llama-13b-python | |
| Code Llama | Code Llama 34B | accounts/fireworks/models/code-llama-34b | 32,768 |
| Code Llama | Code Llama 34B Instruct | accounts/fireworks/models/code-llama-34b-instruct | |
| Code Llama | Code Llama 34B Python | accounts/fireworks/models/code-llama-34b-python | |
| Code Llama | Code Llama 70B | accounts/fireworks/models/code-llama-70b | |
| Code Llama | Code Llama 70B Instruct | accounts/fireworks/models/code-llama-70b-instruct | |
| Code Llama | Code Llama 70B Python | accounts/fireworks/models/code-llama-70b-python | |
| Code Llama | Code Llama 7B | accounts/fireworks/models/code-llama-7b | |
| Code Llama | Code Llama 7B Instruct | accounts/fireworks/models/code-llama-7b-instruct | |
| Code Llama | Code Llama 7B Python | accounts/fireworks/models/code-llama-7b-python | |
| DeepSeek Coder | DeepSeek Coder 33B Instruct | accounts/fireworks/models/deepseek-coder-33b-instruct | |
| DeepSeek Coder | DeepSeek Coder 7B Base | accounts/fireworks/models/deepseek-coder-7b-base | |
| DeepSeek Coder | DeepSeek Coder 7B Base v1.5 | accounts/fireworks/models/deepseek-coder-7b-base-v1p5 | |
| DeepSeek Coder | DeepSeek Coder 7B Instruct v1.5 | accounts/fireworks/models/deepseek-coder-7b-instruct-v1p5 | |
| Llama | Llama v2 13B Code | accounts/fireworks/models/llama-v2-13b-code | |
| Llama | Llama v2 13B Code Instruct | accounts/fireworks/models/llama-v2-13b-code-instruct | |
| Llama | Llama v2 34B Code | accounts/fireworks/models/llama-v2-34b-code | |
| Llama | Llama v2 70B Code Instruct | accounts/fireworks/models/llama-v2-70b-code-instruct | |
| Code Llama | Phind Code Llama 34B Python v1 | accounts/fireworks/models/phind-code-llama-34b-python-v1 | |
| Code Llama | Phind Code Llama 34B v1 | accounts/fireworks/models/phind-code-llama-34b-v1 | |
| Code Llama | Phind Code Llama 34B v2 | accounts/fireworks/models/phind-code-llama-34b-v2 | |
| Stable Code | Stable Code 3B | accounts/stability/models/stablecode-3b | |
| StarCoder | StarCoder2 15B | accounts/fireworks/models/starcoder2-15b |