Know a great AI tool or AI news source? Submit it to AiByts

Getting Started With (Offline) Agent Evals

We built an eval for our agent's tool selection, learned it was measuring the wrong thing, and fixed it. The three-level framework, the LangSmith code to reproduce each step, and what it cost.

By Josiah CoadMarky Blog
Getting Started With (Offline) Agent Evals

Read the full story

Originally published by Marky Blog on Jul 19, 2026.

Read on Marky Blog(opens in a new tab)

Comments

Sign in to join the discussion.

No comments yet — be the first to share your thoughts.