If you encounter the following error: 
Invalid LoRA weight model.layers.0.self_attn.q_proj.lora_A.weight shape: torch.Size([16, 4096]), expected (16, 8192)
This issue is due to the fireworks.json file being set to Llama 3.1 70b instruct by default. Workaround:
  1. Download the model weights.
  2. Modify the base model to be accounts/fireworks/models/llama-v3p1-8b-instruct.
  3. Follow the instructions in the documentation to upload and deploy the model.