Skill UI

A systematic workflow designed to significantly improve the reliability and performance of existing AI agents. It covers detailed performance analysis, including gathering metrics (e.g., task success rate, latency), classifying failure modes, and advanced prompt engineering techniques (like Chain-of-Thought and Constitutional AI). The process culminates in structured A/B testing and controlled deployment, ensuring measurable, robust improvements.

This skill defines structured behavioral frameworks (e.g., Brainstorm, Implement, Debug, Review, Teach, Ship) to guide the AI's output and approach based on the specific task phase. It optimizes performance by ensuring the AI adopts the correct mindset and output format—from initial ideation to final deployment—guaranteeing systematic, high-quality results across the entire development lifecycle.

Provides comprehensive guidance on building robust evaluation frameworks for complex agent systems. It addresses the inherent challenges of non-determinism and multiple valid paths, enabling systematic performance testing, validating context engineering choices, and measuring continuous improvements across multiple quality dimensions (e.g., factual accuracy, tool efficiency).

A comprehensive diagnostic toolkit designed for advanced troubleshooting of Lindy AI agents. This bundle systematically collects environment information (OS, Python, Node.js), tests API connectivity for webhooks and major integrations (Slack, Notion, Gmail), reviews task history, and guides the user in generating a full, structured support ticket for technical support.

Master comprehensive strategies for evaluating Large Language Model (LLM) applications. This skill covers automated metrics (BLEU, ROUGE, BERTScore), structured human evaluation dimensions, and advanced LLM-as-Judge techniques. Use it to systematically measure model performance, compare prompts, detect regressions, and build confidence in production systems.

This skill guides the design and implementation of a complete, production-grade Machine Learning pipeline. It employs a multi-agent orchestration workflow, systematically covering all stages of the ML lifecycle: data ingestion and quality assurance, feature engineering, model training, optimization, and robust deployment (MLOps). It ensures built-in reproducibility, monitoring, and scalability.

A comprehensive guide to building production-grade evaluation systems for Large Language Models (LLMs). This skill covers advanced methodologies, including Direct Scoring and Pairwise Comparison, alongside critical techniques for mitigating systematic biases (e.g., Position Bias, Length Bias). Learn how to select appropriate metrics and structure prompts to ensure reliable, consistent, and objective quality assessment across various AI applications.

This advanced workflow orchestrates the entire research idea lifecycle. Starting from a broad research direction, it systematically executes literature mapping, creative brainstorming, novelty verification, and proposal refinement. The final output is a validated IDEA_REPORT, a detailed proposal, and a concrete experiment plan, transforming preliminary concepts into actionable, structured research projects. Ideal for users needing a full, end-to-end research guidance system.

This tool allows users to systematically evaluate and rank the outputs of multiple agents within an AgentHub session. It supports metric-based evaluation (running custom commands for measurable metrics like speed or resource usage), or an advanced LLM Judge Mode. The LLM Judge compares results based on criteria like correctness, simplicity, and overall quality, helping users determine the best-performing agent for the task.

This skill systematically probes an AI model's core behavioral patterns across six critical dimensions, including reasoning, refusal, formatting, and grounding. It generates a comprehensive, styled HTML report with radar charts and actionable insights, allowing users to understand a model's true capabilities, compare different models, or perform compliance and red-team assessments without needing an external API key.

This tool systematically designs and plans ablation studies crucial for advanced research paper submissions. It simulates the role of a rigorous ML reviewer, guiding the process of isolating the specific contributions of each novel component, testing hyperparameter sensitivities, and addressing potential reviewer questions. The workflow ensures that every experiment has a clear hypothesis, maximizing the scientific impact of the research results.

This skill provides a systematic, four-phase workflow for diagnosing and recovering from AI agent failures. It guides the agent to first capture the failure state, diagnose the root cause (e.g., loop, context overflow, state drift), apply minimal containment recovery actions, and finally generate a detailed introspection report, minimizing the need for human intervention.