List Deployments

GET

accounts

{account_id}

deployments

curl --request GET \
  --url https://api.fireworks.ai/v1/accounts/{account_id}/deployments \
  --header 'Authorization: Bearer <token>'

{
  "deployments": [
    {
      "name": "<string>",
      "displayName": "<string>",
      "description": "<string>",
      "createTime": "2023-11-07T05:31:56Z",
      "expireTime": "2023-11-07T05:31:56Z",
      "purgeTime": "2023-11-07T05:31:56Z",
      "deleteTime": "2023-11-07T05:31:56Z",
      "createdBy": "<string>",
      "state": "STATE_UNSPECIFIED",
      "status": {
        "code": "OK",
        "message": "<string>"
      },
      "minReplicaCount": 123,
      "maxReplicaCount": 123,
      "replicaCount": 123,
      "autoscalingPolicy": {
        "scaleUpWindow": "<string>",
        "scaleDownWindow": "<string>",
        "scaleToZeroWindow": "<string>",
        "loadTargets": {}
      },
      "baseModel": "<string>",
      "acceleratorCount": 123,
      "acceleratorType": "ACCELERATOR_TYPE_UNSPECIFIED",
      "precision": "PRECISION_UNSPECIFIED",
      "cluster": "<string>",
      "enableAddons": true,
      "draftTokenCount": 123,
      "draftModel": "<string>",
      "ngramSpeculationLength": 123,
      "numPeftDeviceCached": 123,
      "deploymentTemplate": "<string>",
      "autoTune": {
        "longPrompt": true
      },
      "region": "REGION_UNSPECIFIED",
      "isNim": true,
      "updateTime": "2023-11-07T05:31:56Z"
    }
  ],
  "nextPageToken": "<string>",
  "totalSize": 123
}

Authorizations

Authorization

string

header

required

Bearer authentication header of the form Bearer <token>, where <token> is your auth token.

Path Parameters

account_id

string

required

The Account Id

Query Parameters

pageSize

integer

The maximum number of deployments to return. The maximum page_size is 200, values above 200 will be coerced to 200. If unspecified, the default is 50.

pageToken

string

A page token, received from a previous ListDeployments call. Provide this to retrieve the subsequent page. When paginating, all other parameters provided to ListDeployments must match the call that provided the page token.

filter

string

Only deployment satisfying the provided filter (if specified) will be returned. See https://google.aip.dev/160 for the filter grammar.

orderBy

string

A comma-separated list of fields to order by. e.g. "foo,bar" The default sort order is ascending. To specify a descending order for a field, append a " desc" suffix. e.g. "foo desc,bar" Subfields are specified with a "." character. e.g. "foo.bar" If not specified, the default order is by "create_time".

showDeleted

boolean

If set, DELETED deployments will be included.

Response

200 - application/json

A successful response.

deployments

object[]

deployments.baseModel

string

required

deployments.name

string

deployments.displayName

string

Human-readable display name of the deployment. e.g. "My Deployment" Must be fewer than 64 characters long.

deployments.description

string

Description of the deployment.

deployments.createTime

string

The creation time of the deployment.

deployments.expireTime

string

The time at which this deployment will automatically be deleted.

deployments.purgeTime

string

The time at which the resource will be hard deleted.

deployments.deleteTime

string

The time at which the resource will be soft deleted.

deployments.createdBy

string

The email address of the user who created this deployment.

deployments.state

enum<string>

default:STATE_UNSPECIFIED

The state of the deployment.

Available options:

STATE_UNSPECIFIED,

CREATING,

READY,

DELETING,

FAILED,

UPDATING,

DELETED

deployments.status

object

Detailed status information regarding the most recent operation.

deployments.minReplicaCount

integer

The minimum number of replicas. If not specified, the default is 0.

deployments.maxReplicaCount

integer

The maximum number of replicas. If not specified, the default is max(min_replica_count, 1). May be set to 0 to downscale the deployment to 0.

deployments.replicaCount

integer

deployments.autoscalingPolicy

object

deployments.acceleratorCount

integer

The number of accelerators used per replica. If not specified, the default is the estimated minimum required by the base model.

deployments.acceleratorType

enum<string>

default:ACCELERATOR_TYPE_UNSPECIFIED

The type of accelerator to use. If not specified, the default is NVIDIA_A100_80GB.

Available options:

ACCELERATOR_TYPE_UNSPECIFIED,

NVIDIA_A100_80GB,

NVIDIA_H100_80GB,

AMD_MI300X_192GB,

NVIDIA_A10G_24GB,

NVIDIA_A100_40GB,

NVIDIA_L4_24GB,

NVIDIA_H200_141GB,

NVIDIA_B200_180GB

deployments.precision

enum<string>

default:PRECISION_UNSPECIFIED

The precision with which the model should be served.

Available options:

PRECISION_UNSPECIFIED,

FP16,

FP8,

FP8_MM,

FP8_AR,

FP8_MM_KV_ATTN,

FP8_KV,

FP8_MM_V2,

FP8_V2,

FP8_MM_KV_ATTN_V2,

NF4

deployments.cluster

string

If set, this deployment is deployed to a cloud-premise cluster.

deployments.enableAddons

boolean

If true, PEFT addons are enabled for this deployment.

deployments.draftTokenCount

integer

The number of candidate tokens to generate per step for speculative decoding. Default is the base model's draft_token_count. Set CreateDeploymentRequest.disable_speculative_decoding to false to disable this behavior.

deployments.draftModel

string

The draft model name for speculative decoding. e.g. accounts/fireworks/models/my-draft-model If empty, speculative decoding using a draft model is disabled. Default is the base model's default_draft_model. Set CreateDeploymentRequest.disable_speculative_decoding to false to disable this behavior.

deployments.ngramSpeculationLength

integer

The length of previous input sequence to be considered for N-gram speculation.

deployments.numPeftDeviceCached

integer

deployments.deploymentTemplate

string

The name of the deployment template to use for this deployment. Only available to enterprise accounts.

deployments.autoTune

object

The performance profile to use for this deployment.

deployments.region

enum<string>

default:REGION_UNSPECIFIED

The geographic region where the deployment is located.

Available options:

REGION_UNSPECIFIED,

US_IOWA_1,

US_VIRGINIA_1,

US_VIRGINIA_2,

US_ILLINOIS_1,

AP_TOKYO_1,

EU_LONDON_1,

US_ARIZONA_1,

US_TEXAS_1,

US_ILLINOIS_2,

EU_FRANKFURT_1,

US_TEXAS_2,

EU_PARIS_1,

EU_HELSINKI_1,

US_NEVADA_1,

EU_ICELAND_1,

EU_ICELAND_2

deployments.isNim

boolean

Whether this deployment should be created with NIM.

deployments.updateTime

string

The update time for the deployment.

nextPageToken

string

A token, which can be sent as page_token to retrieve the next page. If this field is omitted, there are no subsequent pages.

totalSize

integer

The total number of deployments.

Get Account Get Deployment

curl --request GET \
  --url https://api.fireworks.ai/v1/accounts/{account_id}/deployments \
  --header 'Authorization: Bearer <token>'

{
  "deployments": [
    {
      "name": "<string>",
      "displayName": "<string>",
      "description": "<string>",
      "createTime": "2023-11-07T05:31:56Z",
      "expireTime": "2023-11-07T05:31:56Z",
      "purgeTime": "2023-11-07T05:31:56Z",
      "deleteTime": "2023-11-07T05:31:56Z",
      "createdBy": "<string>",
      "state": "STATE_UNSPECIFIED",
      "status": {
        "code": "OK",
        "message": "<string>"
      },
      "minReplicaCount": 123,
      "maxReplicaCount": 123,
      "replicaCount": 123,
      "autoscalingPolicy": {
        "scaleUpWindow": "<string>",
        "scaleDownWindow": "<string>",
        "scaleToZeroWindow": "<string>",
        "loadTargets": {}
      },
      "baseModel": "<string>",
      "acceleratorCount": 123,
      "acceleratorType": "ACCELERATOR_TYPE_UNSPECIFIED",
      "precision": "PRECISION_UNSPECIFIED",
      "cluster": "<string>",
      "enableAddons": true,
      "draftTokenCount": 123,
      "draftModel": "<string>",
      "ngramSpeculationLength": 123,
      "numPeftDeviceCached": 123,
      "deploymentTemplate": "<string>",
      "autoTune": {
        "longPrompt": true
      },
      "region": "REGION_UNSPECIFIED",
      "isNim": true,
      "updateTime": "2023-11-07T05:31:56Z"
    }
  ],
  "nextPageToken": "<string>",
  "totalSize": 123
}

API Documentation

LLM API

Embeddings API

Image API

Audio API

Accounts

Deployments

Models

LoRAs

Supervised Fine Tuning Jobs

Users

Datasets

API Keys

Authorizations

Path Parameters

Query Parameters

Response