Skill UI

A comprehensive tool for designing, generating schemas, and evaluating complex multi-agent systems. It guides users through defining system requirements, selecting optimal orchestration patterns (Supervisor, Swarm, Pipeline), generating provider-ready tool schemas (Anthropic/OpenAI), and analyzing execution logs for performance bottlenecks, cost, and latency. This ensures robust, production-grade autonomous workflows.

A comprehensive framework for rigorously testing and benchmarking LLM agents. It moves beyond simple pass/fail checks to assess complex behaviors, reliability metrics, and capability consistency across multiple runs. Ideal for production monitoring and identifying subtle failure modes in advanced AI agents.

This framework provides a comprehensive, structured approach for making critical architectural decisions. It guides users through requirements analysis, detailed trade-off evaluation, and documenting decisions using Architecture Decision Records (ADRs). It is essential when analyzing or designing complex system architectures to ensure simplicity, robustness, and maintainability.

This is a high-level Software Development Kit (SDK) designed for managing the full lifecycle of AI projects within Azure AI Foundry. Built for Java, it provides robust client interfaces for core AI operations, including managing connections to Azure resources, uploading and managing datasets, creating and updating search indexes, running model evaluations, and handling deployments. It streamlines complex AI workflow orchestration.

This is a high-level Software Development Kit (SDK) designed for managing the full lifecycle of AI projects within Azure AI Foundry. Built for Java, it provides robust client interfaces for core AI operations, including managing connections to Azure resources, uploading and managing datasets, creating and updating search indexes, running model evaluations, and handling deployments. It streamlines complex AI workflow orchestration.

This is the .NET SDK for managing Arize AI Observability and Evaluation resources within Azure Resource Manager (ARM). It provides programmatic access to create, read, update, and delete AI organization resources. It is essential for MLOps professionals and developers who need to monitor, track, and evaluate the performance of AI models deployed on Azure.

Generates Python code and workflows for collaborative, content-based, or hybrid recommendation models, handling data prep, training, evaluation, and scalability so Claude can deliver tailored suggestions across domains.

Guides CTOs and tech leaders through strategy, architecture governance, team scaling, and crisis response, with workflows for technical debt assessment, ADR creation, and vendor evaluation to keep engineering healthy.

Formal evaluation framework for Claude Code sessions that applies evaluation-driven development to define capability and regression checks, run deterministic and model graders, and track pass@k/pass^k reliability metrics before shipping.

A comprehensive toolkit for evaluating the performance of code generation models. It supports benchmarking against industry standards like HumanEval, MBPP, and MultiPL-E across multiple languages. Use this tool to quantitatively compare different LLM coding abilities and measure code synthesis quality using pass@k metrics.

Evaluates large language models across 60+ academic benchmarks (MMLU, HumanEval, GSM8K, TruthfulQA, HellaSwag) with standardized prompts and metrics, making it easy to benchmark HuggingFace or API models, compare releases, and track training progress.

Provides detailed evaluation of machine learning models using plugin metrics to assess accuracy, precision, recall, F1, and other key indicators, helping users compare models and validate performance before deployment.