Skill UI

A comprehensive framework for rigorously testing and benchmarking LLM agents. It moves beyond simple pass/fail checks to assess complex behaviors, reliability metrics, and capability consistency across multiple runs. Ideal for production monitoring and identifying subtle failure modes in advanced AI agents.

This comprehensive guide details the architecture of memory for intelligent agents. It covers the distinction between short-term context, long-term vector storage, and advanced cognitive models (CoALA framework: semantic, episodic, procedural). Learn how to implement robust memory retrieval mechanisms, select appropriate vector databases (Pinecone, Qdrant, etc.), and utilize embedding models to build truly context-aware, persistent AI applications.

An advanced AI-driven framework for holistic performance engineering of multi-agent systems. It provides coordinated profiling, workload distribution, and cost-aware orchestration across various domains (database, application, frontend). Use this tool to identify bottlenecks, improve throughput, enhance reliability, and manage resource constraints in complex agent workflows.

A comprehensive, multi-phase workflow designed for building sophisticated AI systems. This guide covers everything from designing autonomous agents and implementing single-agent logic, to orchestrating complex multi-agent systems and integrating advanced tools and memory mechanisms. Ideal for developers building production-grade AI applications using frameworks like CrewAI and LangGraph.

A comprehensive, multi-phase workflow designed for building sophisticated AI systems. This guide covers everything from designing autonomous agents and implementing single-agent logic, to orchestrating complex multi-agent systems and integrating advanced tools and memory mechanisms. Ideal for developers building production-grade AI applications using frameworks like CrewAI and LangGraph.

A comprehensive SDK for building real-time, bidirectional voice AI applications using Azure AI services within the .NET framework. This library facilitates seamless voice interactions, supporting WebSocket communication, advanced features like function calling, and handling audio/text streaming events for developing sophisticated virtual assistants.

This skill defines structured behavioral frameworks (e.g., Brainstorm, Implement, Debug, Review, Teach, Ship) to guide the AI's output and approach based on the specific task phase. It optimizes performance by ensuring the AI adopts the correct mindset and output format—from initial ideation to final deployment—guaranteeing systematic, high-quality results across the entire development lifecycle.

Guides researchers through ten structured ideation frameworks to move from vague curiosity to actionable, defensible research proposals, supporting exploration of new problem spaces, pivoting projects, and surfacing high-impact angles.

Formal evaluation framework for Claude Code sessions that applies evaluation-driven development to define capability and regression checks, run deterministic and model graders, and track pass@k/pass^k reliability metrics before shipping.

Provides comprehensive guidance on building robust evaluation frameworks for complex agent systems. It addresses the inherent challenges of non-determinism and multiple valid paths, enabling systematic performance testing, validating context engineering choices, and measuring continuous improvements across multiple quality dimensions (e.g., factual accuracy, tool efficiency).

This advanced skill is a multi-agent research framework designed for executing deep, extensive research in parallel. It orchestrates a team of 10 specialized agents to gather, synthesize, and analyze information simultaneously. It is ideal for complex topics that require rapid, broad, and battle-tested investigation across multiple dimensions, significantly accelerating the knowledge discovery process.

Master the LangChain framework, the industry standard for building sophisticated and production-grade Large Language Model (LLM) applications. This skill covers core concepts including autonomous agents, multi-step chains, memory management, Retrieval-Augmented Generation (RAG), and external tool integration, enabling the development of complex, stateful AI systems.