pandaprobe
Developed by chirpz-ai
PandaProbe is an open-source AI agent engineering platform by Chirpz AI that helps teams collaboratively trace, evaluate, monitor, and debug AI agents. It works by capturing full agent execution workflows—including LLM calls, tool usage, and custom logic—as granular traces. Featuring an asynchronous architecture backed by Redis and LiteLLM, it facilitates robust LLM-as-a-judge evaluations to track quality regressions. Offering both a freemium cloud tier and self-hosted Docker deployment, it integrates seamlessly with major agentic frameworks.
- Full-lifecycle Agent Tracing
- LLM-as-a-judge Evaluation
- Visual Debugging & Analytics
- Asynchronous Processing Architecture
- Cloud-managed & Self-hosted
web