curl --request POST \
--url https://api.fireworks.ai/inference/v1/messages \
--header 'Authorization: Bearer <token>' \
--header 'Content-Type: application/json' \
--data '
{
"max_tokens": 1024,
"messages": [
{
"content": "Hello, world",
"role": "user"
}
],
"model": "claude-opus-4-6"
}
'{
"id": "<string>",
"type": "message",
"role": "assistant",
"content": [
{
"citations": [
{
"cited_text": "<string>",
"document_index": 1,
"document_title": "<string>",
"end_char_index": 123,
"file_id": "<string>",
"start_char_index": 1,
"type": "char_location"
}
],
"text": "<string>",
"type": "text"
}
],
"model": "<string>",
"stop_reason": "end_turn",
"stop_sequence": "<string>",
"raw_output": {
"prompt_fragments": [
"<string>"
],
"prompt_token_ids": [
123
],
"completion": "<string>",
"completion_token_ids": [
123
],
"images": [
"<string>"
],
"grammar": "<string>"
}
}Anthropic-compatible endpoint.
Send a structured list of input messages with text and/or image content, and the model will generate the next message in the conversation.
The Messages API can be used for either single queries or stateless multi-turn conversations.
Fireworks Quickstarts:
curl --request POST \
--url https://api.fireworks.ai/inference/v1/messages \
--header 'Authorization: Bearer <token>' \
--header 'Content-Type: application/json' \
--data '
{
"max_tokens": 1024,
"messages": [
{
"content": "Hello, world",
"role": "user"
}
],
"model": "claude-opus-4-6"
}
'{
"id": "<string>",
"type": "message",
"role": "assistant",
"content": [
{
"citations": [
{
"cited_text": "<string>",
"document_index": 1,
"document_title": "<string>",
"end_char_index": 123,
"file_id": "<string>",
"start_char_index": 1,
"type": "char_location"
}
],
"text": "<string>",
"type": "text"
}
],
"model": "<string>",
"stop_reason": "end_turn",
"stop_sequence": "<string>",
"raw_output": {
"prompt_fragments": [
"<string>"
],
"prompt_token_ids": [
123
],
"completion": "<string>",
"completion_token_ids": [
123
],
"images": [
"<string>"
],
"grammar": "<string>"
}
}Bearer authentication using your Fireworks API key. Format: Bearer <API_KEY>
The model that will complete your prompt. See the Fireworks Model Library for available models.
Input messages.
Models are trained to operate on alternating user and assistant conversational turns. When creating a new Message, you specify the prior conversational turns with the messages parameter, and the model then generates the next Message in the conversation. Consecutive user or assistant turns in your request will be combined into a single turn.
Each input message must be an object with a role and content. You can specify a single user-role message, or you can include multiple user and assistant messages.
If the final message uses the assistant role, the response content will continue immediately from the content in that message. This can be used to constrain part of the model's response.
Example with a single user message:
[{"role": "user", "content": "Hello"}]Example with multiple conversational turns:
[
{"role": "user", "content": "Hello there."},
{"role": "assistant", "content": "Hi, I'm here to help. How can I help you?"},
{"role": "user", "content": "Can you explain LLMs in plain English?"},
]Example with a partially-filled response from the model:
[
{"role": "user", "content": "What's the Greek name for Sun? (A) Sol (B) Helios (C) Sun"},
{"role": "assistant", "content": "The best answer is ("},
]Each input message content may be either a single string or an array of content blocks, where each block has a specific type. Using a string for content is shorthand for an array of one content block of type "text". The following input messages are equivalent:
{"role": "user", "content": "Hello"}{"role": "user", "content": [{"type": "text", "text": "Hello"}]}See input examples.
Note that if you want to include a system prompt, you can use the top-level system parameter — there is no "system" role for input messages in the Messages API.
There is a limit of 100,000 messages in a single request.
Show child attributes
The maximum number of tokens to generate before stopping.
Note that models may stop before reaching this maximum. This parameter only specifies the absolute maximum number of tokens to generate.
Different models have different maximum values for this parameter. See models for details.
x >= 11024
An object describing metadata about the request.
Show child attributes
Configuration options for the model's output, such as the output format.
Show child attributes
Custom text sequences that will cause the model to stop generating.
Models will normally stop when they have naturally completed their turn, which will result in a response stop_reason of "end_turn".
If you want the model to stop generating when it encounters custom strings of text, you can use the stop_sequences parameter. If the model encounters one of the custom sequences, the response stop_reason value will be "stop_sequence" and the response stop_sequence value will contain the matched stop sequence.
System prompt.
A system prompt is a way of providing context and instructions to the model, such as specifying a particular goal or role. See the guide to system prompts.
[
{
"text": "Today's date is 2024-06-01.",
"type": "text"
}
]Amount of randomness injected into the response.
Defaults to 1.0. Ranges from 0.0 to 1.0. Use temperature closer to 0.0 for analytical / multiple choice, and closer to 1.0 for creative and generative tasks.
Note that even with temperature of 0.0, the results will not be fully deterministic.
0 <= x <= 11
Configuration for enabling the model's extended thinking.
When enabled, responses include thinking content blocks showing the model's thinking process before the final answer. Requires a minimum budget of 1,024 tokens and counts towards your max_tokens limit.
See reasoning for details.
Note: The adaptive thinking type is not supported yet.
Show child attributes
The model will automatically decide whether to use tools.
Show child attributes
Definitions of tools that the model may use.
If you include tools in your API request, the model may return tool_use content blocks that represent the model's use of those tools. You can then run those tools using the tool input generated by the model and then optionally return results back to the model using tool_result content blocks.
Each tool definition includes:
name: Name of the tool.description: Optional, but strongly-recommended description of the tool.input_schema: JSON schema for the tool input shape that the model will produce in tool_use output content blocks.For example, if you defined tools as:
[
{
"name": "get_stock_price",
"description": "Get the current stock price for a given ticker symbol.",
"input_schema": {
"type": "object",
"properties": {
"ticker": {
"type": "string",
"description": "The stock ticker symbol, e.g. AAPL for Apple Inc."
}
},
"required": ["ticker"]
}
}
]And then asked the model "What's the S&P 500 at today?", the model might produce tool_use content blocks in the response like this:
[
{
"type": "tool_use",
"id": "toolu_01D7FLrfh4GYq7yT1ULFeyMV",
"name": "get_stock_price",
"input": { "ticker": "^GSPC" }
}
]You might then run your get_stock_price tool with {"ticker": "^GSPC"} as an input, and return the following back to the model in a subsequent user message:
[
{
"type": "tool_result",
"tool_use_id": "toolu_01D7FLrfh4GYq7yT1ULFeyMV",
"content": "259.75 USD"
}
]Tools can be used for workflows that include running client-side tools and functions, or more generally whenever you want the model to produce a particular JSON structure of output.
See the guide for more details.
Show child attributes
{
"description": "Get the current weather in a given location",
"input_schema": {
"properties": {
"location": {
"description": "The city and state, e.g. San Francisco, CA",
"type": "string"
},
"unit": {
"description": "Unit for the output - one of (celsius, fahrenheit)",
"type": "string"
}
},
"required": ["location"],
"type": "object"
},
"name": "get_weather"
}Only sample from the top K options for each subsequent token.
Used to remove "long tail" low probability responses. Learn more technical details here.
Recommended for advanced use cases only. You usually only need to use temperature.
x >= 05
Use nucleus sampling.
In nucleus sampling, we compute the cumulative distribution over all the options for each subsequent token in decreasing probability order and cut it off once it reaches a particular probability specified by top_p. You should either alter temperature or top_p, but not both.
Recommended for advanced use cases only. You usually only need to use temperature.
0 <= x <= 10.7
Return raw output from the model.
Message object.
Unique object identifier.
The format and length of IDs may change over time.
"msg_013Zva2CMHLNnXjNJJKqJ2EF"
Object type.
For Messages, this is always "message".
"message"Conversational role of the generated message.
This will always be "assistant".
"assistant"Content generated by the model.
This is an array of content blocks, each of which has a type that determines its shape.
Example:
[{"type": "text", "text": "Hi, I'm here to help."}]If the request input messages ended with an assistant turn, then the response content will continue directly from that last turn. You can use this to constrain the model's output.
For example, if the input messages were:
[
{"role": "user", "content": "What's the Greek name for Sun? (A) Sol (B) Helios (C) Sun"},
{"role": "assistant", "content": "The best answer is ("}
]Then the response content might be:
[{"type": "text", "text": "B)"}]Show child attributes
[
{
"citations": null,
"text": "Hi! How can I help you today?",
"type": "text"
}
]The model that will complete your prompt. See the Fireworks Model Library for available models.
The reason that the model stopped.
This may be one the following values:
"end_turn": the model reached a natural stopping point"max_tokens": the model exceeded the requested max_tokens or the model's maximum"stop_sequence": one of your provided custom stop_sequences was generated"tool_use": the model invoked one or more tools"pause_turn": the model paused a long-running turn. You may provide the response back as-is in a subsequent request to let the model continue."refusal": when streaming classifiers intervene to handle potential policy violationsIn non-streaming mode this value is always non-null. In streaming mode, it is null in the message_start event and non-null otherwise.
end_turn, max_tokens, stop_sequence, tool_use, pause_turn, refusal Which custom stop sequence was generated, if any.
This value will be a non-null string if one of your custom stop sequences was generated.
Fireworks extension that returns low-level details of what the model sees, including the formatted prompt and function calls.
Show child attributes
Was this page helpful?