Documentation Index
Fetch the complete documentation index at: https://docs.fireworks.ai/llms.txt
Use this file to discover all available pages before exploring further.
Serverless API
Image Models
All image models deployed are accessible via Image Playground and the Serverless API.
We offer on-demand deployments of image models if you have larger volume of traffic and need better response times.
| Model Family | Model Name | Model ID for API |
|---|
| Stable Diffusion | SD3 | accounts/stability/models/sd3 |
| Stable Diffusion | SD3 Medium | accounts/stability/models/sd3-medium |
| Stable Diffusion | Stable Diffusion XL 1024 v1.0 | accounts/fireworks/models/stable-diffusion-xl-1024-v1-0 |
| Playground | Playground v2 1024px Aesthetic | accounts/fireworks/models/playground-v2-1024px-aesthetic |
| Playground | Playground v2.5 1024px Aesthetic | accounts/fireworks/models/playground-v2-5-1024px-aesthetic |
| Stable Diffusion | SSD-1B | accounts/fireworks/models/SSD-1B |
| Stable Diffusion | Japanese Stable Diffusion XL | accounts/fireworks/models/japanese-stable-diffusion-xl |
| Stable Diffusion | SD3 Turbo | accounts/stability/models/sd3-turbo |
Language Models
These models are already deployed and ready to be accessed from our Serverless API, pick up the appropriate model string from the table to starting making a API Request.
You can refer the Querying Text Models guide for getting started.
| Model Family | Model Name | Model ID for API |
|---|
| FireLLaVA | FireLLaVA-13B | accounts/fireworks/models/firellava-13b |
| FireFunction | FireFunction v1 | accounts/fireworks/models/firefunction-v1 |
| Mixtral | Mixtral 8x7B Instruct | accounts/fireworks/models/mixtral-8x7b-instruct |
| Llama | Llama v3 70B Instruct | accounts/fireworks/models/llama-v3-70b-instruct |
| Bleat | Bleat Adapter | accounts/fireworks/models/bleat-adapter |
| DBRX | DBRX Instruct | accounts/fireworks/models/dbrx-instruct |
| Gemma | Gemma 7B IT | accounts/fireworks/models/gemma-7b-it |
| Hermes | Hermes 2 Pro Mistral 7B | accounts/fireworks/models/hermes-2-pro-mistral-7b |
| Stable LM | Japanese Stable LM Instruct Beta 70B | accounts/stability/models/japanese-stablelm-instruct-beta-70b |
| Stable LM | Japanese Stable LM Instruct Gamma 7B | accounts/stability/models/japanese-stablelm-instruct-gamma-7b |
| Llama | Llama v2 13B | accounts/fireworks/models/llama-v2-13b |
| Llama | Llama v2 13B Chat | accounts/fireworks/models/llama-v2-13b-chat |
| Llama | Llama v2 34B Code Instruct | accounts/fireworks/models/llama-v2-34b-code-instruct |
| Llama | Llama v2 70B Chat | accounts/fireworks/models/llama-v2-70b-chat |
| Llama | Llama v2 7B | accounts/fireworks/models/llama-v2-7b |
| Llama | Llama v2 7B Chat | accounts/fireworks/models/llama-v2-7b-chat |
| Llama | Llama v3 70B Instruct HF | accounts/fireworks/models/llama-v3-70b-instruct-hf |
| Llama | Llama v3 8B HF | accounts/fireworks/models/llama-v3-8b-hf |
| Llama | Llama v3 8B Instruct | accounts/fireworks/models/llama-v3-8b-instruct |
| Llama | Llama v3 8B Instruct HF | accounts/fireworks/models/llama-v3-8b-instruct-hf |
| LLaVA | LLaVA Yi 34B | accounts/fireworks/models/llava-yi-34b |
| Mistral | Mistral 7B | accounts/fireworks/models/mistral-7b |
| Mistral | Mistral 7B Instruct 4K | accounts/fireworks/models/mistral-7b-instruct-4k |
| Mistral | Mistral 7B Instruct v0.2 | accounts/fireworks/models/mistral-7b-instruct-v0p2 |
| Mistral | Mistral 7B Instruct v3 | accounts/fireworks/models/mistral-7b-instruct-v3 |
| Mixtral | Mixtral 8x22B | accounts/fireworks/models/mixtral-8x22b |
| Mixtral | Mixtral 8x22B HF | accounts/fireworks/models/mixtral-8x22b-hf |
| Mixtral | Mixtral 8x22B Instruct HF | accounts/fireworks/models/mixtral-8x22b-instruct-hf |
| Mixtral | Mixtral 8x7B | accounts/fireworks/models/mixtral-8x7b |
| Mixtral | Mixtral 8x7B Instruct HF | accounts/fireworks/models/mixtral-8x7b-instruct-hf |
| MythoMax | MythoMax L2 13B | accounts/fireworks/models/mythomax-l2-13b |
| Nous Hermes | Nous Hermes 2 Mixtral 8x7B DPO FP8 | accounts/fireworks/models/nous-hermes-2-mixtral-8x7b-dpo-fp8 |
| Phi | Phi 3 Mini 128K Instruct | accounts/fireworks/models/phi-3-mini-128k-instruct |
| Phi | Phi 3 Vision 128K Instruct | accounts/fireworks/models/phi-3-vision-128k-instruct |
| Qwen | Qwen1.5 72B Chat | accounts/fireworks/models/qwen1p5-72b-chat |
| Qwen | Qwen2 72B Instruct | accounts/fireworks/models/qwen2-72b-instruct |
| Stable LM | Stable LM 2 Zephyr 2B | accounts/stability/models/stablelm-2-zephyr-2b |
| Stable LM | Stable LM Zephyr 3B | accounts/stability/models/stablelm-zephyr-3b |
Code Generation Models
| Model Family | Model Name | Model ID for API |
|---|
| StarCoder | StarCoder 16B | accounts/fireworks/models/starcoder-16b |
On-demand Models
Models that are available on platform to quickly deploy for inference on Fireworks AI API.
To get started, you can refer the guide on on-demand deployments
Language Models
| Model Family | Model Name | Model ID for API |
|---|
| Chronos | Chronos Hermes 13B v2 | accounts/fireworks/models/chronos-hermes-13b-v2 |
| DBRX | DBRX Instruct FP8 | accounts/fireworks/models/dbrx-instruct-fp8 |
| Qwen | Dolphin 2.9.2 Qwen2 72B | accounts/fireworks/models/dolphin-2-9-2-qwen2-72b |
| Mixtral | Dolphin 2.6 Mixtral 8x7B | accounts/fireworks/models/dolphin-2p6-mixtral-8x7b |
| Llama | ELYZA Japanese Llama 2 7B Fast Instruct | accounts/fireworks/models/elyza-japanese-llama-2-7b-fast-instruct |
| Gemma | Gemma 7B | accounts/fireworks/models/gemma-7b |
| Stable VLM | Japanese Stable VLM 8B | accounts/stability/models/japanese-stable-vlm-8b |
| Llama Guard | Llama Guard 2 8B | accounts/fireworks/models/llama-guard-2-8b |
| Llama Guard | Llama Guard 7B | accounts/fireworks/models/llamaguard-7b |
| Mistral | Mistral 7B v0.2 | accounts/fireworks/models/mistral-7b-v0p2 |
| Mixtral | Mixtral 8x22B Instruct | accounts/fireworks/models/mixtral-8x22b-instruct |
| Mixtral | Mixtral 8x22B Instruct Preview | accounts/fireworks/models/mixtral-8x22b-instruct-preview |
| Nous Capybara | Nous Capybara 7B v1.9 | accounts/fireworks/models/nous-capybara-7b-v1p9 |
| Nous Hermes | Nous Hermes 2 Mixtral 8x7B DPO | accounts/fireworks/models/nous-hermes-2-mixtral-8x7b-dpo |
| Nous Hermes | Nous Hermes 2 Yi 34B | accounts/fireworks/models/nous-hermes-2-yi-34b |
| Nous Hermes | Nous Hermes Llama2 13B | accounts/fireworks/models/nous-hermes-llama2-13b |
| Nous Hermes | Nous Hermes Llama2 70B | accounts/fireworks/models/nous-hermes-llama2-70b |
| Nous Hermes | Nous Hermes Llama2 7B | accounts/fireworks/models/nous-hermes-llama2-7b |
| OpenChat | OpenChat 3.5 0106 7B | accounts/fireworks/models/openchat-3p5-0106-7b |
| OpenHermes | OpenHermes 2 Mistral 7B | accounts/fireworks/models/openhermes-2-mistral-7b |
| OpenHermes | OpenHermes 2.5 Mistral 7B | accounts/fireworks/models/openhermes-2p5-mistral-7b |
| Mistral | OpenOrca 7B | accounts/fireworks/models/openorca-7b |
| Phi | Phi 2 3B | accounts/fireworks/models/phi-2-3b |
| Pythia | Pythia 12B | accounts/fireworks/models/pythia-12b |
| Qwen | Qwen 14B Chat | accounts/fireworks/models/qwen-14b-chat |
| Qwen | Qwen 72B Chat | accounts/fireworks/models/qwen-72b-chat |
| Snorkel | Snorkel Mistral 7B PairRM DPO | accounts/fireworks/models/snorkel-mistral-7b-pairrm-dpo |
Code Generation
| Model Family | Model Name | Model ID for API | |
|---|
| Code Llama | Code Llama 13B | accounts/fireworks/models/code-llama-13b | 32,768 |
| Code Llama | Code Llama 13B Instruct | accounts/fireworks/models/code-llama-13b-instruct | |
| Code Llama | Code Llama 13B Python | accounts/fireworks/models/code-llama-13b-python | |
| Code Llama | Code Llama 34B | accounts/fireworks/models/code-llama-34b | 32,768 |
| Code Llama | Code Llama 34B Instruct | accounts/fireworks/models/code-llama-34b-instruct | |
| Code Llama | Code Llama 34B Python | accounts/fireworks/models/code-llama-34b-python | |
| Code Llama | Code Llama 70B | accounts/fireworks/models/code-llama-70b | |
| Code Llama | Code Llama 70B Instruct | accounts/fireworks/models/code-llama-70b-instruct | |
| Code Llama | Code Llama 70B Python | accounts/fireworks/models/code-llama-70b-python | |
| Code Llama | Code Llama 7B | accounts/fireworks/models/code-llama-7b | |
| Code Llama | Code Llama 7B Instruct | accounts/fireworks/models/code-llama-7b-instruct | |
| Code Llama | Code Llama 7B Python | accounts/fireworks/models/code-llama-7b-python | |
| DeepSeek Coder | DeepSeek Coder 33B Instruct | accounts/fireworks/models/deepseek-coder-33b-instruct | |
| DeepSeek Coder | DeepSeek Coder 7B Base | accounts/fireworks/models/deepseek-coder-7b-base | |
| DeepSeek Coder | DeepSeek Coder 7B Base v1.5 | accounts/fireworks/models/deepseek-coder-7b-base-v1p5 | |
| DeepSeek Coder | DeepSeek Coder 7B Instruct v1.5 | accounts/fireworks/models/deepseek-coder-7b-instruct-v1p5 | |
| Llama | Llama v2 13B Code | accounts/fireworks/models/llama-v2-13b-code | |
| Llama | Llama v2 13B Code Instruct | accounts/fireworks/models/llama-v2-13b-code-instruct | |
| Llama | Llama v2 34B Code | accounts/fireworks/models/llama-v2-34b-code | |
| Llama | Llama v2 70B Code Instruct | accounts/fireworks/models/llama-v2-70b-code-instruct | |
| Code Llama | Phind Code Llama 34B Python v1 | accounts/fireworks/models/phind-code-llama-34b-python-v1 | |
| Code Llama | Phind Code Llama 34B v1 | accounts/fireworks/models/phind-code-llama-34b-v1 | |
| Code Llama | Phind Code Llama 34B v2 | accounts/fireworks/models/phind-code-llama-34b-v2 | |
| Stable Code | Stable Code 3B | accounts/stability/models/stablecode-3b | |
| StarCoder | StarCoder2 15B | accounts/fireworks/models/starcoder2-15b | |
