2 stories
AI agent costs grow faster than the work itself, and caching is how you bring them back down. Gareth Bland, Chief Data Scientist at Microsoft, explains. From our full conversation on TokenOps (https://youtu.be/B4yovi_znxE). #AIAgents #TokenOps
AI agent costs don't grow in step with the work. As an agent takes more turns, context piles up and uncached input costs rise on a quadratic curve: in Gareth Bland's example, an agent that takes four times as many turns costs sixteen times as much.
Showing 2 of 2 stories
You're all caught up.
Get the top AI news and tools straight to your inbox every week.
Weekly · AI news
Join 15,000+ AI enthusiasts
