This is an early release preview. You may encounter bugs.

Catalogue

Submit a tool

Harnesses, frameworks, tools, apps, and platforms for agent builders, each scored on real GitHub credibility and each with a credibility-gated forum.

47 tools · showing 1–24

#observability ×
Platform

Sentry

Monitoring

getsentry

Performance monitoring and error tracking.

observabilityapmsession-replaytelemetry

A+
Framework

Dify

Coding

langgenius

Open-source LLM app development platform combining a visual workflow canvas, RAG pipelines, agents, model management, and observability

productivityragagent-builderorchestrationobservability

A+
Tool

PostHog

CodingMonitoring

PostHog

Open-source product analytics platform.

product-analyticssession-replayfeature-flagsobservability

A+
Tool

AxonHub

CodingInterface

looplj

AI gateway that translates any SDK's requests to any provider, with tracing, RBAC, load balancing, and cost tracking

gatewayobservabilityauthtoken-optimization

A+
Framework

Agno

CodingDeployment

agno-agi

SDK, AgentOS runtime, and web UI for building and operating multi-tenant agent platforms on your own infrastructure

authobservabilitycroncontrol-plane

A+
Tool

Langfuse

MonitoringQA

langfuse

Open-source platform for tracing, evaluating, and debugging LLM applications, self-hosted or cloud

observabilityevaluationpromptlocal-first

A+
Framework

NeMo Agent Toolkit

CodingMonitoringQA

NVIDIA

Library for connecting, profiling and optimizing teams of agents across frameworks.

profilingobservabilityevaluationmulti-agent

A+
Framework

OpenAI Agents SDK

CodingVoiceSecurity

openai

Python framework for multi-agent workflows with handoffs, guardrails, sessions, sandbox and voice agents, and built-in tracing

multi-agentguardrailsobservabilitysandbox

A+
Tool

Opik

Monitoring

comet-ml

Open-source platform for tracing, evaluating, and monitoring LLM and agentic applications

observabilityevaluationpromptlangchain

A+
Tool

Netdata

DeploymentMonitoring

netdata

During an incident you can now point Claude or Cursor at your running infrastructure and ask what changed. Netdata ships

observabilitytelemetryanomaly-detectionmcp-server

A+
Tool

OpenSRE

DeploymentMonitoring

Tracer-Cloud

Build your own AI SRE agents. The open source toolkit for the AI era.

sreincident-responsedebuggingobservability

A+
Tool

Latitude

Monitoring

latitude-dev

Latitude traces your agent in production, finds the failures, and dispatches your coding agent to fix them.

observabilityissue-detectiontelemetryevaluation

A+
Tool

Agentgateway

Deployment

agentgateway

Open source proxy built on AI-native protocols (MCP & A2A) that provides drop-in security, observability, and governance for agent-to-LLM, agent-to-tool, and agent-to-agent communication across any framework and environment.

gatewaya2aproxyobservability

A
Tool

Logfire

Monitoring

pydantic

OpenTelemetry-based observability platform with Python-centric insights, SQL querying, and Pydantic integration

telemetryobservabilitypydanticfastapi

A
Tool

Phoenix

Monitoring

Arize-ai

Open-source AI observability platform for tracing, evaluating, and troubleshooting LLM and agent applications

observabilityevaluationllmopsrag

A
Framework

Workflow DevKit

CodingDeploymentMonitoring

vercel

Durable, resumable workflow primitives for long-running agent runs.

sdkdurable-executionobservabilityserverless

A
Tool

MLflow

Monitoring

mlflow

Open-source platform to trace, evaluate, monitor, and deploy LLM applications, agents, and ML models

observabilityevaluationllmopsmlops

A
Tool

Langsmith SDK

Coding

langchain-ai

Python and JavaScript SDKs for tracing, evaluating and monitoring LLM apps on the LangSmith platform

observabilityevaluationlangchain

A
Tool

Sentry MCP

MonitoringCoding

getsentry

MCP server giving coding agents access to Sentry issues and traces.

sentryobservabilitydebuggingmcp-server

A
Tool

VoltAgent

CodingInterfaceMonitoring

VoltAgent

TypeScript framework and console for building, observing, and operating AI agents

ragobservabilityorchestration

A
Tool

dbt MCP Server

Connectors

dbt-labs

MCP server exposing dbt Core/Fusion/Platform project context and commands to AI agents.

dbtsemantic-layersqldata-engineering

A
Tool

Inspector

CodingDeploymentSecurity

MCPJam

Development and testing platform to debug, chat with, inspect, and run evals against MCP servers, MCP apps, and ChatGPT apps

oauthevaluationdebuggingobservability

A
Tool

OpenInference

Monitoring

Arize-ai

OpenTelemetry auto-instrumentation that converts agent traces to OpenInference for Arize Phoenix / AX.

telemetryobservabilitylangchainllamaindex

A
Tool

Weave

MonitoringQA

wandb

Tracing, evaluation and LLM-as-judge scoring for agent applications.

observabilityevaluationwandb

A