How can we benchmark? - Fireworks AI Docs

There are multiple ways to benchmark your deployment’s performance:

Use our open-source load-testing tool
Develop custom performance testing scripts
Integrate with monitoring tools to track metrics

What are the techniques to improve performance?

What’s the latency for small, medium, and large LLM models?