Translate audio

The input audio file to translate or an URL to the public audio file.

Max audio file size is 1 GB, there is no limit for audio duration. Common file formats such as mp3, flac, and wav are supported. Note that the audio will be resampled to 16kHz, downmixed to mono, and reformatted to 16-bit signed little-endian format before transcription. Pre-converting the file before sending it to the API can improve runtime performance.

String name of the ASR model to use. Can be one of whisper-v3 or whisper-v3-turbo. Please use the following serverless endpoints:

• https://audio-prod.us-virginia-1.direct.fireworks.ai (for whisper-v3);
• https://audio-turbo.us-virginia-1.direct.fireworks.ai (for whisper-v3-turbo);

String name of the voice activity detection (VAD) model to use. Can be one of silero, or whisperx-pyannet.

String name of the alignment model to use. Currently supported:

• mms_fa optimal accuracy for multilingual speech.
• tdnn_ffn optimal accuracy for English-only speech.
• gentle best accuracy for English-only speech (requires a dedicated endpoint, contact us at inquiries@fireworks.ai).

The target language for transcription. See the Supported Languages section below for a complete list of available languages.

The input prompt that the model will use when generating the transcription. Can be used to specify custom words or specify the style of the transcription. E.g. Um, here's, uh, what was recorded. will make the model to include the filler words into the transcription.

Sampling temperature to use when decoding text tokens during transcription. Alternatively, fallback decoding can be enabled by passing a list of temperatures like 0.0,0.2,0.4,0.6,0.8,1.0. This can help to improve performance.

The format in which to return the response. Can be one of json, text, srt, verbose_json, or vtt.

The timestamp granularities to populate for this transcription. response_format must be set verbose_json to use timestamp granularities. Either or both of these options are supported. Can be one of word, segment, or word,segment. If not present, defaults to segment.

Audio preprocessing mode. Currently supported:

• none to skip audio preprocessing.
• dynamic for arbitrary audio content with variable loudness.
• soft_dynamic for speech intense recording such as podcasts and voice-overs.
• bass_dynamic for boosting lower frequencies;