DigitalOcean5 min read
Prompt Caching is GA on DigitalOcean Serverless Inference: Up to 90% Off the Context Your Agents Resend
Prompt caching is now generally available on DigitalOcean Serverless Inference, across supported models in our open model catalog, with no changes to your request code required. Cached Input is billed at up to 90% off and time to first token drops by up to 80%.
By DigitalOceanDigitalOcean Blog

Read the full story
Originally published by DigitalOcean Blog on Oct 23, 2026.
Comments
Sign in to join the discussion.