Skip to main content

​
Model guardrails

Q: Do you put any guardrails before any LLM models? By default, we don’t apply any guardrails to LLM models. Our customers can implement guardrails through various methods:
  1. Using built-in options:
    • Models such as Llama Guard provide built-in guardrails.
    • Integration with existing security frameworks.
  2. Third-party solutions:
    • AI gateways like Portkey offer guardrails as a feature.
    • Documentation available at: Portkey Guardrails
Best practices:
  • Implement guardrails appropriate to your use case.
  • Conduct regular security audits.
  • Monitor model outputs consistently.
  • Keep security policies updated.

​
Additional information

If you experience any issues during these processes, you can: