How Prompt Caching Cuts AI Costs by 90%

Prompt caching, introduced by Anthropic in July 2024 and also offered by other major LLM providers, can cut AI API costs by up to 90%. This optimization reuses previously computed internal states for common prompt portions, leading to faster responses and significant savings.