Skill UI

Phoenix is an open-source observability platform for tracing, evaluating, and monitoring LLM applications; use it to debug prompts, run dataset evaluations, build experiment pipelines, and watch production inference in real time.

The Phoenix CLI is a powerful tool for debugging complex LLM and agent workflows. It allows users to fetch detailed traces, spans, and sessions, analyze errors, and structure findings using open and axial coding techniques. It is essential for investigating complex LLM failures, building robust failure taxonomies, and guiding the next steps in application evaluation after initial instrumentation.

Phoenix Evals lets teams build evaluators for AI/LLM apps by wiring deterministic code with LLM nuance, running Python or TypeScript workloads, validating against humans, and iterating through error analysis, RAG, and production workflows.

Guides hooking Phoenix AI services with OpenInference tracing, covering setup, spans, instrumentation, and production deployment for LLM workflows using Python or TypeScript.