Billing & Pricing
Is prompt caching billed differently for serverless models?
No, prompt caching does not affect billing for serverless models. You are charged the same amount regardless of whether your request benefits from prompt caching or not.
No, prompt caching does not affect billing for serverless models. You are charged the same amount regardless of whether your request benefits from prompt caching or not.