Skill UI

A systematic workflow designed to significantly improve the reliability and performance of existing AI agents. It covers detailed performance analysis, including gathering metrics (e.g., task success rate, latency), classifying failure modes, and advanced prompt engineering techniques (like Chain-of-Thought and Constitutional AI). The process culminates in structured A/B testing and controlled deployment, ensuring measurable, robust improvements.

A comprehensive collection of battle-tested, structured prompts designed to elevate interactions with Large Language Models (LLMs). Covers advanced use cases including expert coding reviews, system architecture design, performance analysis, technical writing, and creative brainstorming, ensuring high-quality, actionable AI output.

This skill provides comprehensive tools for documenting and managing model performance on Hugging Face. It supports multiple methods for adding structured evaluation data, including extracting tables from README content, importing benchmark scores via APIs (like Artificial Analysis), and executing high-performance custom evaluations using advanced backends such as vLLM or lighteval. It ensures that all metadata is structured and compatible with model leaderboards and industry standards.

This skill guides users on setting up and running LLM-as-judge evaluations using Arize. It covers defining evaluators (including prompts, classification choices, and models) and executing tasks against real data spans or experiments. It supports key metrics like hallucination, faithfulness, and correctness, and facilitates continuous monitoring for comprehensive LLM performance analysis.

A comprehensive evaluation suite designed to benchmark the performance of Large Language Models (LLM) and Vision-Language Models (VLM) specifically for home security applications. It covers 143 diverse tests across 16 critical domains, including tool use, prompt injection resistance, contextual reasoning, alert triage, and detailed scene analysis, ensuring robustness for smart home AI systems.

This harness provides comprehensive, reproducible evaluation pipelines for complex LLM chains and agents (LangChain/LangGraph 1.0). It integrates golden dataset management, LangSmith evaluation, RAGAS metrics, deepeval LLM-as-judge, and structured agent trajectory analysis. Use it when establishing quality benchmarks for new chains, diagnosing performance regressions after model switches, or implementing CI/CD gates to prevent quality drops.

This skill provides comprehensive analysis and improvement suggestions for plugin prompts, skill definitions, and command instructions. It evaluates content across five dimensions—clarity, safety, effectiveness, completeness, and conciseness—providing a detailed score card and concrete, actionable rewrites to ensure compliance and optimal AI performance.

This comprehensive benchmark suite evaluates the performance of Vision-Language Models (VLM) on complex video anomaly detection tasks using the SmartHome-Bench dataset. It covers a wide range of real-world smart home scenarios, including security breaches, elderly fall detection, and unusual pet behavior. Unlike single-frame analysis, this benchmark requires deep multi-frame video understanding, making it a robust tool for testing the advanced AI capabilities of video monitoring systems.

This skill provides real-time object detection capabilities by leveraging the Google Coral Edge TPU accelerator. It operates natively within Windows Subsystem for Linux (WSL), allowing high-speed, low-latency inference on live camera frames. By utilizing hardware acceleration, it achieves impressive performance (e.g., ~4ms inference at 320x320), making it ideal for edge computing projects requiring rapid visual analysis and resource efficiency.

This skill implements advanced 'Gatekeeper' logic to optimize AI agent performance in long-running workflows. It prevents context window bloat by sharding metadata, allocating token budgets, and enforcing Atomic Precision to deliver purely functional, filler-free responses. Ideal for complex coding, multi-step reasoning, and large document analysis where conciseness is critical.

This skill provides a detailed, side-by-side comparison of advanced LLM agent evaluation frameworks, such as ruflo and HAL. It helps researchers and developers identify capability gaps—including real code execution, full web browsing, and structured file parsing—and prioritize architectural improvements for robust agent benchmarking and performance tracking.

This skill automates the creation of comprehensive Model Cards for OpenMed clinical NER or de-identification models. It gathers data from various OpenMed evaluation reports (e.g., `GateReport`, `fairness_report`, `error_report`) to structure critical governance information, including intended use, quantitative performance metrics, subgroup analysis, limitations, and required medical-device disclaimers. It ensures documentation is reproducible and compliant for clinical AI deployment.