- Deployment type (serverless or on-demand)
- Traffic patterns and request patterns
- Hardware configuration
- Model size and complexity
Deployment & Infrastructure
What’s the supported throughput?
Throughput capacity typically depends on several factors:
Was this page helpful?
Do you support Auto Scaling?
Previous
What factors affect the number of simultaneous requests that can be handled?
Next
⌘I