Know a great AI tool or AI news source? Submit it to AiByts

AI Observability AI Tools

14 tools

Get the best AI tools in your inbox

Join 10,000+ builders and get weekly updates.

Weekly · AI Infrastructure AI Tools

Tools

  • Respan

    AI Infrastructure

    AI router with built-in observability and automated evaluations.

    • LLM Observability
    • Automated Evals
    • Prompt Optimization

    Freemium

  • Keywords AI

    AI Infrastructure

    AI router with observability and automated evaluations

    • LLM Engineering
    • LLM Observability
    • LLM Evals

    Freemium

  • Latitude

    AI Infrastructure

    Open-source AI agent monitoring platform with full observability into production failures.

    • Agent Monitoring
    • Self-Healing
    • Behavior Patterns

    Paid

  • Braintrust

    AI Infrastructure

    Tracks and evaluates AI agents for quality and performance.

    • AI Evaluation
    • LLM Evaluation
    • AI Testing

    Freemium

  • Opik

    AI Infrastructure

    End-to-end AI observability platform for developers with agent testing, optimization, and monitoring.

    • AI Observability
    • LLM Monitoring
    • Agent Testing

    Freemium

  • ClawMetry

    AI Infrastructure

    Monitor and govern AI agent activity, spend, and actions with ClawMetry.

    • AI Agents
    • Data Analysis

    Freemium

  • OpenObserve

    AI Infrastructure

    High-performance, unified observability for the AI era with 140x lower storage cost.

      Freemium

    • Portkey

      AI Infrastructure

      Productionize Gen AI across your org with AI gateway, observability, guardrails, and prompt management.

      • AI Gateway
      • LLM Orchestration
      • Compliance Certifications

      Free

    • Traccia

      AI Infrastructure

      AI agent control plane for observability, evaluation, and governance

        Freemium

      • AIWatch

        AI Infrastructure

        Monitors real-time status of 46 AI services for downtime and incidents.

          Free

        • TraceLLM

          AI Infrastructure

          Monitors and traces AI application performance with production data.

          • Arize Phoenix

            AI Infrastructure

            AI observability and evaluation tool for developers

              Free

            • TensorZero

              AI Infrastructure

              Builds open-source tools for production-grade LLM applications

              • Helicone

                AI Infrastructure

                Routing and monitoring for reliable AI apps

                • LLM Observability
                • AI Gateway

                Freemium

              Showing 1–14 of 14 tools