Skill UI

This skill performs a comprehensive SEO audit by crawling up to 500 pages and delegating tasks to 15 specialized subagents. It analyzes technical health, content quality, performance, and local SEO factors to generate a health score from 0-100. Use this for full SEO checks, site analysis, or website health evaluations. It produces detailed reports and prioritized action plans.

This skill initializes a new autoresearch experiment. It guides the user through defining all necessary parameters, including the domain, target files, evaluation commands, metrics, and optimization direction. It is the essential starting point for automated optimization and performance benchmarking cycles.

This skill is designed for running comprehensive evaluations of Hugging Face Hub models on local hardware. It supports multiple evaluation frameworks, including `inspect-ai` and `lighteval`, and provides flexibility in backend selection (e.g., `vllm`, Transformers, or `accelerate`) to optimize for performance and compatibility. Use this for local GPU benchmarking, smoke testing, and backend selection, but note that it does not handle remote job orchestration or result publishing.

A comprehensive, generics-first utility library designed for Go developers who prefer declarative, functional programming patterns over manual loops. It provides 500+ type-safe functions for common data transformations (Map, Filter, Reduce, GroupBy, etc.) on slices, maps, and strings. By defaulting to immutable operations, it ensures thread safety and predictable state changes. The library also offers specialized packages (lop, lom, loi) to address performance bottlenecks, such as CPU-bound parallel processing or lazy evaluation, allowing engineers to choose the optimal approach for their c...

This skill provides comprehensive commands to manage the entire AI model evaluation lifecycle using Arize. Users can list, retrieve metadata, and export results from experiments. It is ideal for comparing multiple model runs, benchmarking performance against a dataset, and analyzing model accuracy using structured evaluation workflows (CRUD operations).

This skill guides users on setting up and running LLM-as-judge evaluations using Arize. It covers defining evaluators (including prompts, classification choices, and models) and executing tasks against real data spans or experiments. It supports key metrics like hallucination, faithfulness, and correctness, and facilitates continuous monitoring for comprehensive LLM performance analysis.

Vaex is a high-performance Python library designed for processing and analyzing large tabular datasets that exceed available RAM. It supports out-of-core DataFrame operations, lazy evaluation, fast aggregations, and efficient visualization of big data. Ideal for working with massive CSV, HDF5, Arrow, or Parquet files, performing statistics on billions of rows, and building machine learning pipelines without memory constraints.

A comprehensive evaluation suite designed to benchmark the performance of Large Language Models (LLM) and Vision-Language Models (VLM) specifically for home security applications. It covers 143 diverse tests across 16 critical domains, including tool use, prompt injection resistance, contextual reasoning, alert triage, and detailed scene analysis, ensuring robustness for smart home AI systems.

This harness provides comprehensive, reproducible evaluation pipelines for complex LLM chains and agents (LangChain/LangGraph 1.0). It integrates golden dataset management, LangSmith evaluation, RAGAS metrics, deepeval LLM-as-judge, and structured agent trajectory analysis. Use it when establishing quality benchmarks for new chains, diagnosing performance regressions after model switches, or implementing CI/CD gates to prevent quality drops.

This skill provides a detailed, side-by-side comparison of advanced LLM agent evaluation frameworks, such as ruflo and HAL. It helps researchers and developers identify capability gaps—including real code execution, full web browsing, and structured file parsing—and prioritize architectural improvements for robust agent benchmarking and performance tracking.

Guides users through the entire end-to-end process of running the GAIA benchmark. It covers environment validation, cost estimation, model execution, and generating a signed, HAL-compatible submission package for leaderboards. This ensures high integrity and reproducibility for model performance evaluation.

Generates comprehensive quality intelligence reports by analyzing historical evaluation scores. This tool tracks content performance over time, identifies improving or declining content types, detects significant quality regressions against baselines, and provides prioritized, actionable recommendations for improving brand quality across various content dimensions.