Skill UI

This expert tool guides users through rigorous statistical analysis, specializing in A/B testing, hypothesis testing, and interpreting experimental results. It helps define sample sizes, executes appropriate tests (Z-test, T-test, Chi-square), and critically distinguishes between 'statistical significance' and 'practical significance' to ensure data-driven decision-making for product and business strategy.

Provides patterns and techniques for building robust evaluation loops for AI agents. This skill guides the implementation of self-critique, evaluator-optimizer pipelines, and test-driven refinement workflows. Use it to significantly enhance the accuracy and quality of complex outputs like code, reports, and analyses by implementing structured, iterative improvement cycles (Generate → Evaluate → Critique → Refine).

This specialist simulates the role of an App Store reviewer, auditing iOS source code and metadata against Apple's strict guidelines. It systematically identifies potential compliance risks, technical vulnerabilities, monetization gaps (IAP/Subscriptions), and critical UX shortcomings, delivering a prioritized risk register for fast approval.

A comprehensive tool that analyzes existing codebases to generate detailed, definitive architectural blueprints. It automatically detects technology stacks, identifies architectural patterns (e.g., Microservices, Clean Architecture), and documents implementation details, including dependency flow, cross-cutting concerns (security, logging), and data models. This ensures architectural consistency, aids in onboarding new team members, and guides future development efforts.

This skill provides comprehensive command-line interface (CLI) functionality for managing the entire lifecycle of experiments within the Arize platform. Users can list, retrieve metadata, create new experiments from various data files (CSV, JSON, Parquet), and export detailed run results for deep analysis. It supports linking experiments to specific dataset versions, making it essential for structured ML model evaluation and performance comparison workflows.

Provides comprehensive patterns and techniques for securing AI agent systems. Learn how to enforce governance policies, including tool allow/block lists, content filtering, rate limiting, and human approval workflows. Essential for building robust, compliant, and trustworthy agents in multi-agent or production environments that interact with external APIs and sensitive data.

Checks AI agent implementations against the OWASP Agentic Security Initiative Top 10 risks, producing findings on controls, vulnerabilities, and recommendations for prompt injection, tool governance, escalation, logging, identity, policy, supply chain, and behavioral monitoring before production or audit.

Guide to instrument Azure-hosted ASP.NET Core or Node.js web apps with telemetry reporting to Azure App Insights for improved observability and health tracking.

This skill provides comprehensive command-line capabilities for interacting with Arize datasets. Use it to perform dataset CRUD operations (Create, Read, Update), list available datasets, retrieve detailed metadata, and export large volumes of example data. It is essential for managing the lifecycle of versioned datasets used in model evaluation and machine learning experimentation. Supports file formats like CSV, JSON, and Parquet.

Defines and runs LLM-as-judge evaluators on Arize via ax commands, handling evaluator creation, continuous monitoring, column mapping, trigger runs, and evaluation spans or experiments with configurable templates, models, and query filters.

Use production trace data and the ax CLI to locate LLM prompts, collect annotations/evals, and iterate on prompt templates for data-driven improvements.

Analyzes IaC files and live Azure resources to validate SKUs, usage, and costs, then generates GitHub issues (one per recommendation plus an EPIC) so teams can track implementation of prioritized savings.