Example

Flags

Community

Blog

Fireworks AI Docs

API Reference

Cookbook

Tools & SDK

Get Started

Status

Support

Download a model from third-party locations

Download a model

Fireworks AI is a generative AI inference platform to run and customize models with industry-leading speed and production-readiness.

Introduction

Quickstart

This document outlines basic Fireworks AI concepts.

Concepts

Querying text models

Querying vision-language models

Querying embedding models

Using function-calling

Using grammar mode

Using JSON mode

Prompt caching

Overview

Uploading a custom model

Fine-tuning models

Fine-tuning models via API

Deploying models

Quantization

On-demand deployments

Fireworks runs a global fleet of hardware on which you can deploy your models.

Regions

Reserved capacity

Rate limits, spend limits and quotas for serverless inference and on-demand deployments

Rate limits, spend limits and quotas

Add and delete additional users in your Fireworks account

Managing users

Set up custom Single Sign-On (SSO) authentication for Fireworks AI

Custom SSO

Data privacy & security

This page lists common error codes encountered during inference requests using the Fireworks API, their meanings, and potential resolutions.

Inference errors

Generate an image

Transcribe audio

Translate audio

Align transcription

Transcribe audio (realtime)

Start here

Step-by-step guides for hands-on exploration, ideal for interactive learning of AI techniques.

Build with Fireworks

Creative user-contributed projects that showcase innovative applications of Fireworks in diverse contexts.

Community showcase

Learn to create, deploy, and manage resources using Firectl

Getting Started

Authentication for access to your account

Authentication

List various resources in an Fireworks AI account

List Resources

Create a Deployment on Fireworks AI platform

Create a deployment

Create a fine-tuning job with a base model

Create a fine-tuning job

Create a Dataset on Fireworks AI platform

Create a Dataset

Create Model

Deletes resource(s) in a Fireworks AI account

Delete Resources

Deploy Model

Retrieves model information from Fireworks AI platform

Get Resources

Imports specified model from Fireworks AI Platform

Import Model

Undeploy a model on Fireworks AI platform

Undeploy Model

Updates Resources on Fireworks AI platform

Update Resources

OpenAI compatibility

Get Account

List Deployments

Get Deployment

Create Deployment

Update Deployment

Delete Deployment

Create Deployed Model

Delete Deployed Model

List Models

Get Model

Update Model

Delete Model

Get Model Upload Endpoint

Get Model Download Endpoint

Validate Model Upload

List Users

Get User

Create User

Update User

List Datasets

Get Dataset

Create Dataset

Provides a streamlined way to upload a dataset file in a single API request. This path can handle file sizes up to 150Mb. For larger file sizes use [Get Dataset Upload Endpoint](get-dataset-upload-endpoint).


Tools & SDK

​Example

​Flags

Example

Flags