On-demand deployments

​

Should I use A100s or H100s?

A100s are more affordably priced than H100s but H100s have improved latency and higher total capacity. Generally, we find that H100s tend to be both more performant and more cost-efficient than A100s if you have enough volume to

​

I have more specific performance questions or want to know if there are further performance improvement options

Feel free to schedule directly with our PM Ray Thai (https://calendly.com/raythai)