Skill UI

A systematic workflow designed to significantly improve the reliability and performance of existing AI agents. It covers detailed performance analysis, including gathering metrics (e.g., task success rate, latency), classifying failure modes, and advanced prompt engineering techniques (like Chain-of-Thought and Constitutional AI). The process culminates in structured A/B testing and controlled deployment, ensuring measurable, robust improvements.

This skill defines structured behavioral frameworks (e.g., Brainstorm, Implement, Debug, Review, Teach, Ship) to guide the AI's output and approach based on the specific task phase. It optimizes performance by ensuring the AI adopts the correct mindset and output format—from initial ideation to final deployment—guaranteeing systematic, high-quality results across the entire development lifecycle.

Provides comprehensive guidance on building robust evaluation frameworks for complex agent systems. It addresses the inherent challenges of non-determinism and multiple valid paths, enabling systematic performance testing, validating context engineering choices, and measuring continuous improvements across multiple quality dimensions (e.g., factual accuracy, tool efficiency).

A comprehensive diagnostic toolkit designed for advanced troubleshooting of Lindy AI agents. This bundle systematically collects environment information (OS, Python, Node.js), tests API connectivity for webhooks and major integrations (Slack, Notion, Gmail), reviews task history, and guides the user in generating a full, structured support ticket for technical support.

Master comprehensive strategies for evaluating Large Language Model (LLM) applications. This skill covers automated metrics (BLEU, ROUGE, BERTScore), structured human evaluation dimensions, and advanced LLM-as-Judge techniques. Use it to systematically measure model performance, compare prompts, detect regressions, and build confidence in production systems.

This skill guides the design and implementation of a complete, production-grade Machine Learning pipeline. It employs a multi-agent orchestration workflow, systematically covering all stages of the ML lifecycle: data ingestion and quality assurance, feature engineering, model training, optimization, and robust deployment (MLOps). It ensures built-in reproducibility, monitoring, and scalability.

A comprehensive guide to building production-grade evaluation systems for Large Language Models (LLMs). This skill covers advanced methodologies, including Direct Scoring and Pairwise Comparison, alongside critical techniques for mitigating systematic biases (e.g., Position Bias, Length Bias). Learn how to select appropriate metrics and structure prompts to ensure reliable, consistent, and objective quality assessment across various AI applications.

This skill generates and ranks publishable research ideas based on a broad direction provided by the user. It systematically validates concepts through pilot experiments and model reviews, optimizing for GPU efficiency and novelty. Suitable for brainstorming sessions, academic exploration, and identifying workable research paths.

This tool allows users to systematically evaluate and rank the outputs of multiple agents within an AgentHub session. It supports metric-based evaluation (running custom commands for measurable metrics like speed or resource usage), or an advanced LLM Judge Mode. The LLM Judge compares results based on criteria like correctness, simplicity, and overall quality, helping users determine the best-performing agent for the task.

This skill systematically probes an AI model's core behavioral patterns across six critical dimensions, including reasoning, refusal, formatting, and grounding. It generates a comprehensive, styled HTML report with radar charts and actionable insights, allowing users to understand a model's true capabilities, compare different models, or perform compliance and red-team assessments without needing an external API key.

Designs systematic ablation studies for ML paper submissions. Helps isolate component contributions, test hyperparameters, and answer reviewer questions. Codex plans experiments while CC implements them, ensuring rigorous validation before submission.

This skill provides a systematic, four-phase workflow for diagnosing and recovering from AI agent failures. It guides the agent to first capture the failure state, diagnose the root cause (e.g., loop, context overflow, state drift), apply minimal containment recovery actions, and finally generate a detailed introspection report, minimizing the need for human intervention.