LLM Observability
LLM observability and tracing (Langsmith, Langfuse, Helicone).
Latitude LLM
Latitude is an open-source AI agent monitoring platform that captures full conversation traces, clusters similar failures into triage-ready…
VerifiedOSSFreemium
View tool 
PandaProbe Cloud
The core loop is trace, eval, monitor: capture every span across a session, run research-grounded scoring against those traces, then…
VerifiedFreemium
View tool 
PromptShark
PromptShark is a local MITM proxy written in Go and C++ that sits between your agent and any OpenAI-compatible API endpoint. Every request…
VerifiedOSS
View tool 
Flightdeck
Every LLM call, MCP event, and tool invocation your agents make streams to a live dashboard — per-agent timelines and a fleet-wide feed…
VerifiedOSS
View tool 
AgentMeter
AgentMeter runs locally — no cloud sync, no account creation, no vendor dashboard to log into — and parses the tool calls, token counts…
VerifiedOSS
View tool