Security infrastructure
Model security
Understanding model security and guardrail implementations.
Model guardrails
Q: Do you put any guardrails before any LLM models?
By default, we don’t apply any guardrails to LLM models. Our customers can implement guardrails through various methods:
-
Using built-in options:
- Models such as Llama Guard provide built-in guardrails.
- Integration with existing security frameworks.
-
Third-party solutions:
- AI gateways like Portkey offer guardrails as a feature.
- Documentation available at: Portkey Guardrails
Best practices:
- Implement guardrails appropriate to your use case.
- Conduct regular security audits.
- Monitor model outputs consistently.
- Keep security policies updated.
Additional information
If you experience any issues during these processes, you can:
- Contact support through Discord at discord.gg/fireworks-ai
- Reach out to your account representative (Enterprise customers)
- Email inquiries@fireworks.ai
Was this page helpful?