Skill UI

Formal evaluation framework for Claude Code sessions that applies evaluation-driven development to define capability and regression checks, run deterministic and model graders, and track pass@k/pass^k reliability metrics before shipping.

This tool allows developers to integrate advanced AI video generation (using Kling AI) directly into continuous integration and continuous deployment pipelines (e.g., GitHub Actions, GitLab CI). Automate the creation of marketing videos, product demos, or regression video testing whenever code changes or a release occurs, ensuring consistent and timely video asset updates.

Integrate Langfuse into CI/CD pipelines (e.g., GitHub Actions) to automate the testing and validation of Large Language Models (LLMs). This guide covers prompt regression testing, tracing validation, and setting up experiment-driven quality gates, ensuring reliable and high-performing AI applications throughout the development lifecycle.

LangSmith centralizes tracing, evaluation, and monitoring for LLM applications, letting teams debug prompts, run regression tests, collect latency/cost metrics, and integrate with OpenAI, Anthropic, LangChain, or LlamaIndex to keep production systems observable.

Master comprehensive strategies for evaluating Large Language Model (LLM) applications. This skill covers automated metrics (BLEU, ROUGE, BERTScore), structured human evaluation dimensions, and advanced LLM-as-Judge techniques. Use it to systematically measure model performance, compare prompts, detect regressions, and build confidence in production systems.

Automate the validation and testing of prompts and AI responses within your CI/CD pipeline using Mistral AI. This integration provides robust prompt regression testing, model quality checks, automatic cost estimation for API usage, and deployment gates, ensuring the stability and reliability of your AI features upon every pull request.

Automates comprehensive regression testing for all enabled cloud Large Language Model (LLM) providers. This includes verifying core connectivity, standard chat completion, structured JSON output, and Server-Sent Events (SSE) streaming capabilities. Essential for ensuring the reliability and stability of multi-cloud AI integrations in a CI/CD pipeline.

This harness provides comprehensive, reproducible evaluation pipelines for complex LLM chains and agents (LangChain/LangGraph 1.0). It integrates golden dataset management, LangSmith evaluation, RAGAS metrics, deepeval LLM-as-judge, and structured agent trajectory analysis. Use it when establishing quality benchmarks for new chains, diagnosing performance regressions after model switches, or implementing CI/CD gates to prevent quality drops.

This skill provides a systematic workflow for diagnosing failures in GAIA benchmark runs. Users can analyze task traces, classify failure modes (e.g., Tool Gap, Reasoning Miss, Extraction Bug), identify root causes, and apply targeted fixes to improve AI agent performance. It is essential for optimizing LLM benchmarks and finding performance regressions.

Scikit-learn is the industry-standard Python library for classical machine learning. It provides comprehensive tools for supervised and unsupervised learning tasks, including classification, regression, clustering, and dimensionality reduction. Use it to build robust, production-ready ML pipelines, perform rigorous model evaluation, and preprocess complex datasets for various data science applications.