The Most Common Questions About Agent Evals, Answered
Where to start with agent evals, offline vs online evals, evaluator types, LLM judges, benchmarks with Harbor, multi-turn evals, and keeping costs down.
73 stories
Where to start with agent evals, offline vs online evals, evaluator types, LLM judges, benchmarks with Harbor, multi-turn evals, and keeping costs down.
AI Search uses a model to check session records against plain-language questions. Its fixed reading budget favors conversations over tool output.
Learn how Orange Business used LangChain and LangSmith to build Live Intelligence, a governed AI platform for agents, evals, observability, and production scale.
Open models like GLM-5 and MiniMax M2.7 now match closed frontier models on core agent tasks — file operations, tool use, and instruction following — at a fraction of the cost and latency. Here's what our evals show and how to start using them in Deep Agents.
Built on Deep Agents and LangGraph, Open SWE provides the core architectural components for internal coding agents.
Today we’re launching Deep Agents deploy in beta. Deep Agents deploy is the fastest way to deploy a model agnostic, open source agent harness in a production ready way.
Harness engineering improved LangChain's coding agent from Top 30 to Top 5 on Terminal Bench using self-verification, tracing, and context optimization.
A four-level technical roadmap for building agentic AI systems, from single cognitive loops and stateful memory through multi-agent swarms and production observability.
ChatGPT answers questions… but how do we build AI systems that can actually complete tasks? What should I explain next — Comment below! 👇 In this video, we're exploring LangChain from scratch using one practical real-world example.
AI Search in LangSmith is a new way to query traces using natural language. Describe the behavior you're looking for, and LangSmith returns the traces where it happened.
Use ScaleDown's constrained decoding models with LangChain and Deep Agents to summarize history, compress tool results, and extract data faster and cheaper.
AgentCore pricing re-checked Oct 13, 2026: 12 meters, Runtime v1 at $0.0895 and v2 at $0.1276 per vCPU-hour, per-GB short-term memory, and 5 alternatives.
No — LangChain (LangSmith) is operational. Uptime: 99.98%. 3 incidents tracked (30d). Live status, updated every 5 minutes.
In multi-agent systems, agents can be individually correct and still produce a wrong result when they work together. One agent’s output becomes another agent’s context.
Managed Deep Agents includes a new API for managing reactions for your distributed agents, and a system to dynamically assign emoji responses with your instrument of choice. Learn more.
Discover how Snyk transformed an internal support agent into Snyk Assist, a customer-facing AI feature powered by LangChain, LangGraph, and LangSmith.
Build an agent that pays for real purchases. Restock runs in Slack on Managed Deep Agents and pays with Stripe's Link over the Machine Payments Protocol.
Enterprises are increasingly hesitant to give AI agents carte blanche ability to deploy code or system changes to production without human approval, even as they continue investing in tools designed to evaluate agent reliability.Read more
Showing 18 of 73 stories
Load more storiesGet the top AI news and tools straight to your inbox every week.
Weekly · AI news
Join 15,000+ AI enthusiasts