List Deployments

GET

accounts

{account_id}

deployments

Authorizations

Authorization

string

headerrequired

Bearer authentication header of the form Bearer <token>, where <token> is your auth token.

Path Parameters

account_id

string

required

The Account Id

Query Parameters

pageSize

integer

The maximum number of deployments to return. The maximum page_size is 200, values above 200 will be coerced to 200. If unspecified, the default is 50.

pageToken

string

A page token, received from a previous ListDeployments call. Provide this to retrieve the subsequent page. When paginating, all other parameters provided to ListDeployments must match the call that provided the page token.

filter

string

Only deployment satisfying the provided filter (if specified) will be returned. See https://google.aip.dev/160 for the filter grammar.

orderBy

string

A comma-separated list of fields to order by. e.g. "foo,bar" The default sort order is ascending. To specify a descending order for a field, append a " desc" suffix. e.g. "foo desc,bar" Subfields are specified with a "." character. e.g. "foo.bar" If not specified, the default order is by "create_time".

showDeleted

boolean

If set, DELETED deployments will be included.

Response

200 - application/json

deployments

object[]

deployments.name

string

deployments.displayName

string

Human-readable display name of the deployment. e.g. "My Deployment" Must be fewer than 64 characters long.

deployments.description

string

Description of the deployment.

deployments.createTime

string

The creation time of the deployment.

deployments.expireTime

string

The time at which this deployment will automatically be deleted.

deployments.purgeTime

string

The time at which the resource will be hard deleted.

deployments.createdBy

string

The email address of the user who created this deployment.

deployments.state

enum<string>

default: STATE_UNSPECIFIED

The state of the deployment.

Available options:

STATE_UNSPECIFIED,

CREATING,

READY,

DELETING,

FAILED,

UPDATING,

DELETED

deployments.status

object

Contains detailed message when the last deployment operation fails.

deployments.minReplicaCount

integer

The minimum number of replicas. If not specified, the default is 0.

deployments.maxReplicaCount

integer

The maximum number of replicas. If not specified, the default is max(min_replica_count, 1).

deployments.replicaCount

integer

deployments.autoscalingPolicy

object

deployments.baseModel

string

required

deployments.acceleratorCount

integer

The number of accelerators used per replica. If not specified, the default is the estimated minimum required by the base model.

deployments.acceleratorType

enum<string>

default: ACCELERATOR_TYPE_UNSPECIFIED

The type of accelerator to use. If not specified, the default is NVIDIA_A100_80GB.

Available options:

ACCELERATOR_TYPE_UNSPECIFIED,

NVIDIA_A100_80GB,

NVIDIA_H100_80GB,

AMD_MI300X_192GB,

NVIDIA_A10G_24GB,

NVIDIA_A100_40GB,

NVIDIA_L4_24GB

deployments.precision

enum<string>

default: PRECISION_UNSPECIFIED

The precision with which the model should be served. TODO: Make the default value FP16 once legacy models are fixed.

Available options:

PRECISION_UNSPECIFIED,

FP16,

FP8,

FP8_MM,

FP8_AR,

FP8_MM_KV_ATTN,

FP8_KV,

FP8_MM_V2,

FP8_V2,

FP8_MM_KV_ATTN_V2

deployments.cluster

string

If set, this deployment is deployed to a cloud-premise cluster.

deployments.enableAddons

boolean

If true, PEFT addons are enabled for this deployment.

deployments.draftTokenCount

integer

The number of candidate tokens to generate per step for speculative decoding. Default is the base model's draft_token_count. Set CreateDeploymentRequest.disable_speculative_decoding to false to disable this behavior.

deployments.draftModel

string

The draft model name for speculative decoding. e.g. accounts/fireworks/models/my-draft-model If empty, speculative decoding using a draft model is disabled. Default is the base model's default_draft_model. Set CreateDeploymentRequest.disable_speculative_decoding to false to disable this behavior.

deployments.ngramSpeculationLength

integer

The length of previous input sequence to be considered for N-gram speculation.

deployments.numPeftDeviceCached

integer

deployments.deploymentTemplate

string

The name of the deployment template to use for this deployment. Only available to enterprise accounts.

deployments.autoTune

object

The performance profile to use for this deployment.

deployments.region

enum<string>

default: REGION_UNSPECIFIED

The geographic region where the deployment is located.

Available options:

REGION_UNSPECIFIED,

US_IOWA_1,

US_VIRGINIA_1,

US_VIRGINIA_2,

US_ILLINOIS_1,

AP_TOKYO_1,

EU_LONDON_1,

US_ARIZONA_1,

US_TEXAS_1,

US_ILLINOIS_2,

EU_FRANKFURT_1

nextPageToken

string

A token, which can be sent as page_token to retrieve the next page. If this field is omitted, there are no subsequent pages.

totalSize

integer

The total number of deployments.

Was this page helpful?

Get Account Get Deployment

API Documentation

LLM API

Embeddings API

Image API

Audio API

Accounts

Deployments

Deployed Models

Models

Users

Datasets

Fine-tuning Jobs

Authorizations

Path Parameters

Query Parameters

Response