Skill UI

A comprehensive framework for rigorously testing and benchmarking LLM agents. It moves beyond simple pass/fail checks to assess complex behaviors, reliability metrics, and capability consistency across multiple runs. Ideal for production monitoring and identifying subtle failure modes in advanced AI agents.

This SDK allows developers to build persistent, sophisticated AI agents directly on Azure AI Foundry. It supports complex conversational workflows by integrating external functions (tools), enabling code execution, web search, and maintaining conversation history through dedicated thread management. Ideal for developing enterprise-grade, production-ready AI applications.

This comprehensive guide details the architecture of memory for intelligent agents. It covers the distinction between short-term context, long-term vector storage, and advanced cognitive models (CoALA framework: semantic, episodic, procedural). Learn how to implement robust memory retrieval mechanisms, select appropriate vector databases (Pinecone, Qdrant, etc.), and utilize embedding models to build truly context-aware, persistent AI applications.

An advanced AI-driven framework for holistic performance engineering of multi-agent systems. It provides coordinated profiling, workload distribution, and cost-aware orchestration across various domains (database, application, frontend). Use this tool to identify bottlenecks, improve throughput, enhance reliability, and manage resource constraints in complex agent workflows.

A comprehensive, multi-phase workflow designed for building sophisticated AI systems. This guide covers everything from designing autonomous agents and implementing single-agent logic, to orchestrating complex multi-agent systems and integrating advanced tools and memory mechanisms. Ideal for developers building production-grade AI applications using frameworks like CrewAI and LangGraph.

A comprehensive, multi-phase workflow designed for building sophisticated AI systems. This guide covers everything from designing autonomous agents and implementing single-agent logic, to orchestrating complex multi-agent systems and integrating advanced tools and memory mechanisms. Ideal for developers building production-grade AI applications using frameworks like CrewAI and LangGraph.

Provides comprehensive guidance on building robust evaluation frameworks for complex agent systems. It addresses the inherent challenges of non-determinism and multiple valid paths, enabling systematic performance testing, validating context engineering choices, and measuring continuous improvements across multiple quality dimensions (e.g., factual accuracy, tool efficiency).

This advanced skill is a multi-agent research framework designed for executing deep, extensive research in parallel. It orchestrates a team of 10 specialized agents to gather, synthesize, and analyze information simultaneously. It is ideal for complex topics that require rapid, broad, and battle-tested investigation across multiple dimensions, significantly accelerating the knowledge discovery process.

LangChain accelerates building LLM-powered agents, RAG pipelines, and chatbots by orchestrating models, chains, tools, memory, and vector stores across major providers for rapid prototyping or production deployment.

Master the LangChain framework, the industry standard for building sophisticated and production-grade Large Language Model (LLM) applications. This skill covers core concepts including autonomous agents, multi-step chains, memory management, Retrieval-Augmented Generation (RAG), and external tool integration, enabling the development of complex, stateful AI systems.

This comprehensive guide walks developers through migrating complex LLM codebases from raw SDK calls (OpenAI, Anthropic) or legacy frameworks (LlamaIndex) to the structured LangChain framework. It covers code assessment, pattern-by-pattern migration, advanced agent construction, robust tool calling, and transforming custom RAG pipelines into scalable, standardized chains.

Framework for building stateful, multi-actor AI applications with LangGraph, covering graph construction, reducers, persistence, human-in-the-loop patterns, and ReAct agents suitable for Python production systems.