7 Best Tools for LLM-as-a-Judge Evaluation (2026)
Ask a judge model the same pairwise question 50 times and you’d expect 50 identical verdicts. In a 2026 study of GPT-4o-mini and GPT-4.1-mini as...
73 stories
Ask a judge model the same pairwise question 50 times and you’d expect 50 identical verdicts. In a 2026 study of GPT-4o-mini and GPT-4.1-mini as...
LangChain just released new capabilities in Managed Deep Agents. Agents can now schedule follow-ups, reconfigure themselves on every run, and react to Slack messages.
An LLM can return valid JSON that your application still can’t use. It can accept a malicious prompt without complaint, break a schema on the...
Looking for a Hermes Agent alternative? Six options compared on setup time, hosting, and cost, including when staying on Hermes is the better call.
VentureBeat Intelligence surveyed respondents at organizations with 100 or more employees in its August VB Pulse survey. We asked about AI agent evaluation and production failures, whether agents may push changes to production with no human review, and which evaluation platforms enterprises…
The 11 best AI evaluation tools for production in 2026, ranked by seven criteria checked in vendor docs: online scoring, CI gates, alerts and self-hosting.
I wired TypeSafe’s Jev into a real Claude Code workflow for a week. Here is what the “200x faster, 400x cheaper” headline leaves out.
Building an AI agent is getting easier. Running one reliably in production is still the hard part. At Interrupt 2026, LangChain introduced a major set of updates focused on production agent infrastructure.
How we built a model router into Open SWE's harness that cut median cost per coding task by 64% with no measurable drop in quality, and how to build your own.
Chain Visualization: Reading the Trace Waterfall The spans from the last section don't mean much as a raw list.
🟢 Resolved · lasted 6h 21m All projects ingesting as normal
You’re here because you already know you need to monitor your AI agents. Maybe you’ve looked at LangSmith, Langfuse, Arize, or Braintrust, and now you’re...
Compare 11 AI observability tools for LLM tracing and monitoring in 2026: tracing model, OpenTelemetry support, self-hosting, and which tools changed owners.
LangSmith Custom Apps lets you build the interface you want with your LangSmith data, publish it into your workspace, and skip the hosting, auth, and permissions work. Learn more.
LangChain announced new updates to LangSmith. Updates include Engine v2 with red teaming and automatic testing, a new version of Managed Deep Agents, trajectories and more.
See how LangGraph orchestrates Jev, TypeSafe AI's decision model, to build faster, cheaper production agents.
8 Vertex AI Agent Builder alternatives that are cheaper or simpler: BetterClaw, n8n, Gumloop, CrewAI, Lindy, LangGraph, OpenRouter and AWS AgentCore.
LangSmith Engine now includes Red Teaming to proactively detect agent issues and automated agent testing. Learn more about the Engine v2 release.
Showing 36 of 73 stories
Load more storiesGet the top AI news and tools straight to your inbox every week.
Weekly · AI news
Join 15,000+ AI enthusiasts