firectl supervised-fine-tuning-job create [flags]
Examples
firectl supervised-fine-tuning-job create \
--base-model llama-v3-8b-instruct \
--dataset sample-dataset \
--output-model name-of-the-trained-model
# Create from source job:
firectl supervised-fine-tuning-job create \
--source-job my-previous-job \
--output-model new-model
# Cosine learning rate schedule:
firectl supervised-fine-tuning-job create \
--base-model llama-v3-8b-instruct \
--dataset sample-dataset \
--output-model name-of-the-trained-model \
--learning-rate 0.0001 \
--learning-rate-warmup-steps 10 \
--learning-rate-scheduler cosine \
--learning-rate-min-lr-ratio 0.1 \
--learning-rate-decay-ratio 0.8
Flags
--base-model string The base model for the supervised fine-tuning job. Only one of base-model or warm-start-from should be specified.
--dataset string The dataset for the supervised fine-tuning job. (Required)
--output-model string The output model for the supervised fine-tuning job.
--job-id string The ID of the supervised fine-tuning job. If not set, it will be autogenerated.
--warm-start-from string The model to warm start from. If set, base-model must not be set.
--source-job string The source supervised fine-tuning job to copy configuration from. If other flags are set, they will override the source job's configuration.
--evaluation-dataset string The evaluation dataset for the supervised fine-tuning job.
--epochs int32 The number of epochs for the supervised fine-tuning job.
--learning-rate float32 The learning rate for the supervised fine-tuning job.
--max-context-length int32 Maximum token length per sequence. When unset, defaults to the validated training shape's max supported context length. Capped (not pinned) by the shape: smaller user values are honored.
--batch-size-samples int32 Number of training samples per optimizer step. This is the supported Training V2 batch knob.
--learning-rate-warmup-steps int32 The number of learning rate warmup steps for the supervised fine-tuning job.
--learning-rate-scheduler string Learning rate scheduler to use: constant, linear, or cosine. When unset, the trainer uses its legacy constant schedule.
--learning-rate-min-lr-ratio float32 Minimum learning rate as a ratio of --learning-rate for linear/cosine schedules. Must be between 0 and 1.
--learning-rate-decay-ratio float32 Fraction of total training steps over which to decay for linear/cosine schedules. 0 uses the full run.
--lora-rank int32 The rank of the LoRA layers for the supervised fine-tuning job. Use --full-parameter for full parameter tuning. (default 8)
--optimizer-weight-decay float32 Weight decay (L2 regularization) for the optimizer. Default in trainer is 0.01.
--full-parameter Enable full parameter fine-tuning instead of LoRA. Equivalent to --lora-rank=0. Requires bf16 precision.
--wandb-api-key string [WANDB_API_KEY] WandB API Key. (Required if any WandB flag is set)
--wandb-project string [WANDB_PROJECT] WandB Project. (Required if any WandB flag is set)
--wandb-entity string [WANDB_ENTITY] WandB Entity. (Required if any WandB flag is set)
--wandb Enable WandB
--aws-credentials-secret string [AWS_CREDENTIALS_SECRET] AWS credentials secret (mutually exclusive with --aws-iam-role)
--aws-iam-role string [AWS_IAM_ROLE_ARN] AWS IAM role ARN (mutually exclusive with --aws-credentials-secret)
--azure-credentials-secret string [AZURE_CREDENTIALS_SECRET] Azure credentials secret
--azure-managed-identity-client-id string [AZURE_MANAGED_IDENTITY_CLIENT_ID] Azure managed identity client ID for Workload Identity Federation
--azure-tenant-id string [AZURE_TENANT_ID] Azure tenant ID (required with --azure-managed-identity-client-id)
--display-name string The display name of the supervised fine-tuning job.
--quiet If set, only errors will be printed.
--eval-auto-carveout If set, the evaluation dataset will be auto-carved.
--dry-run Print the request proto without running it.
-o, --output Output Set the output format to "text", "json", or "flag". (default text)
-h, --help help for create
Global flags
-a, --account-id string The Fireworks account ID. If not specified, reads account_id from ~/.fireworks/auth.ini.
--api-key string An API key used to authenticate with Fireworks.
-p, --profile string fireworks auth and settings profile to use.