Skill UI

A comprehensive framework for rigorously testing and benchmarking LLM agents. It moves beyond simple pass/fail checks to assess complex behaviors, reliability metrics, and capability consistency across multiple runs. Ideal for production monitoring and identifying subtle failure modes in advanced AI agents.

A systematic workflow designed to significantly improve the reliability and performance of existing AI agents. It covers detailed performance analysis, including gathering metrics (e.g., task success rate, latency), classifying failure modes, and advanced prompt engineering techniques (like Chain-of-Thought and Constitutional AI). The process culminates in structured A/B testing and controlled deployment, ensuring measurable, robust improvements.

Guides building reliable autonomous agents by covering agent loops, goal decomposition, reflection, and tooling patterns while stressing guardrails, human review, and auditability to curb compounding failure rates in production.

This skill analyzes the predictable ways language models lose performance as context length increases. It details core patterns, including 'lost-in-middle,' context poisoning, and distraction. Use this knowledge to diagnose unpredictable agent failures, design highly reliable systems for long document processing, and implement advanced context engineering strategies.

This comprehensive guide serves as a quick reference for diagnosing and fixing the most frequent errors and exceptions encountered when developing with LangChain. It covers issues such as import failures, API authentication problems, structured output parsing errors (Zod), agent looping, and version mismatches, providing root causes and copy-paste solutions for reliable LLM application development.

A comprehensive guide to diagnose and resolve common errors in Lindy AI agent workflows. Covers troubleshooting issues related to trigger failures (webhooks, email, schedule), action execution errors (Slack, Gmail, HTTP requests, code), and advanced agent step logic problems, ensuring reliable automation.

A comprehensive runbook detailing procedures for responding to failures and outages across Lindy AI agents. Covers critical scenarios including platform downtime (SEV1), individual agent failures, integration authentication issues, credit exhaustion, and webhook endpoint failures. Provides structured diagnostics and fallback strategies to ensure business continuity during incidents.

This resource provides production-ready, structured patterns for building robust voice agent applications using the Retell AI SDK. It covers best practices such as implementing singleton client management, defining typed agent configurations with integrated LLMs, adding automatic retry logic for call failures, and managing large-scale outbound campaigns. Use this when building stable, scalable, and reliable voice automation systems.

This pattern defines a robust, continuous loop structure for autonomous agents. It integrates crucial components like quality gates, evaluation harnesses, and explicit recovery controls. It guides complex workflows by defining decision paths (e.g., PR control, RFC decomposition) and includes strategies to mitigate common failure modes such as infinite loop churn or cost drift, ensuring measurable progress in autonomous systems.

An advanced reliability wrapper for AI agents that monitors, manages, and recovers from tool call failures. It automatically handles common issues such as truncated JSON responses, API timeouts, rate limits, and mid-chain process breakdowns. By implementing sophisticated failure classification, checkpointing, and learning mechanisms, Guardian ensures complex, multi-step agent workflows remain stable and resilient.

This utility checks if the context-mode is properly installed and functioning correctly. It outputs a table showing the status of the installation. If any rows indicate failure, it lists the specific fixes required in order. This tool is useful for developers and system administrators to verify the integrity of the context-mode component before using it in AI workflows.

This skill provides a systematic, four-phase workflow for diagnosing and recovering from AI agent failures. It guides the agent to first capture the failure state, diagnose the root cause (e.g., loop, context overflow, state drift), apply minimal containment recovery actions, and finally generate a detailed introspection report, minimizing the need for human intervention.