Skill UI

Clarity Gate ensures documents entering RAG knowledge bases retain epistemic quality by generating Clarity-Gated Documents, validating Source of Truth tables, and running deterministic claim/document hash scripts before ingestion.

Integrate Langfuse into CI/CD pipelines (e.g., GitHub Actions) to automate the testing and validation of Large Language Models (LLMs). This guide covers prompt regression testing, tracing validation, and setting up experiment-driven quality gates, ensuring reliable and high-performing AI applications throughout the development lifecycle.

Automate the validation and testing of prompts and AI responses within your CI/CD pipeline using Mistral AI. This integration provides robust prompt regression testing, model quality checks, automatic cost estimation for API usage, and deployment gates, ensuring the stability and reliability of your AI features upon every pull request.

This pattern defines a robust, continuous loop structure for autonomous agents. It integrates crucial components like quality gates, evaluation harnesses, and explicit recovery controls. It guides complex workflows by defining decision paths (e.g., PR control, RFC decomposition) and includes strategies to mitigate common failure modes such as infinite loop churn or cost drift, ensuring measurable progress in autonomous systems.

A robust, production-tested pattern for coordinating multiple specialized AI agents. The orchestrator decomposes complex tasks, routes them to the most suitable specialist, prevents redundant or conflicting work (anti-duplication), and enforces mandatory quality gates (e.g., running tests, checking file diffs) to verify results before marking a task as complete. It also includes heartbeat monitoring for task progress.

This harness provides comprehensive, reproducible evaluation pipelines for complex LLM chains and agents (LangChain/LangGraph 1.0). It integrates golden dataset management, LangSmith evaluation, RAGAS metrics, deepeval LLM-as-judge, and structured agent trajectory analysis. Use it when establishing quality benchmarks for new chains, diagnosing performance regressions after model switches, or implementing CI/CD gates to prevent quality drops.

A specialized quality gate skill designed to review complex, multi-source outputs generated by the CrossFrame framework. It rigorously checks reasoning fidelity, evidence boundaries, source anchors, and structural continuity. Use this when advanced verification of logical rigor and source integrity is required, ensuring outputs meet strict internal protocols and avoid common structural failures.

This pattern defines a robust, continuous loop structure for autonomous agents. It integrates crucial components like quality gates, evaluation harnesses, and explicit recovery controls. It guides complex workflows by defining decision paths (e.g., PR control, RFC decomposition) and includes strategies to mitigate common failure modes such as infinite loop churn or cost drift, ensuring measurable progress in autonomous systems.

This skill executes a corpus benchmark to verify the performance and cost claims of the cost booster system. It runs local booster tests against optional baselines like Gemini or Anthropic models. Results are persisted to JSON files for verification gates before releases. It checks win rates and escalation rates to ensure quality improvements and validate upstream tags.

RouterBase acts as a unified, OpenAI-compatible API gateway, allowing applications to route requests across diverse large language models (LLMs) like GPT, Claude, and Gemini. It helps developers migrate existing OpenAI SDK calls, implement sophisticated primary/fallback model selection based on cost, latency, and quality, and manage multimodal payloads (image, audio, video) from a single, standardized endpoint.

Build automated evaluation suites for AI agents with golden datasets, rubrics, and regression gates. Covers unit, tool-calling, end-to-end, and safety evals to validate prompt changes and gate deployments on quality.

Turns your Kanban board (Asana, GitHub Projects, Linear) into an autonomous AI development pipeline with multi-worker Claude Code dispatch, deterministic quality gates, adversarial review, cost tracking, and recoverable task state.