Skill UI

A comprehensive framework for rigorously testing and benchmarking LLM agents. It moves beyond simple pass/fail checks to assess complex behaviors, reliability metrics, and capability consistency across multiple runs. Ideal for production monitoring and identifying subtle failure modes in advanced AI agents.

This comprehensive guide details the architecture of memory for intelligent agents. It covers the distinction between short-term context, long-term vector storage, and advanced cognitive models (CoALA framework: semantic, episodic, procedural). Learn how to implement robust memory retrieval mechanisms, select appropriate vector databases (Pinecone, Qdrant, etc.), and utilize embedding models to build truly context-aware, persistent AI applications.

An advanced AI-driven framework for holistic performance engineering of multi-agent systems. It provides coordinated profiling, workload distribution, and cost-aware orchestration across various domains (database, application, frontend). Use this tool to identify bottlenecks, improve throughput, enhance reliability, and manage resource constraints in complex agent workflows.

A comprehensive, multi-phase workflow designed for building sophisticated AI systems. This guide covers everything from designing autonomous agents and implementing single-agent logic, to orchestrating complex multi-agent systems and integrating advanced tools and memory mechanisms. Ideal for developers building production-grade AI applications using frameworks like CrewAI and LangGraph.

A comprehensive, multi-phase workflow designed for building sophisticated AI systems. This guide covers everything from designing autonomous agents and implementing single-agent logic, to orchestrating complex multi-agent systems and integrating advanced tools and memory mechanisms. Ideal for developers building production-grade AI applications using frameworks like CrewAI and LangGraph.

Provides comprehensive guidance on building robust evaluation frameworks for complex agent systems. It addresses the inherent challenges of non-determinism and multiple valid paths, enabling systematic performance testing, validating context engineering choices, and measuring continuous improvements across multiple quality dimensions (e.g., factual accuracy, tool efficiency).

This advanced skill is a multi-agent research framework designed for executing deep, extensive research in parallel. It orchestrates a team of 10 specialized agents to gather, synthesize, and analyze information simultaneously. It is ideal for complex topics that require rapid, broad, and battle-tested investigation across multiple dimensions, significantly accelerating the knowledge discovery process.

Master the LangChain framework, the industry standard for building sophisticated and production-grade Large Language Model (LLM) applications. This skill covers core concepts including autonomous agents, multi-step chains, memory management, Retrieval-Augmented Generation (RAG), and external tool integration, enabling the development of complex, stateful AI systems.

This comprehensive guide walks developers through migrating complex LLM codebases from raw SDK calls (OpenAI, Anthropic) or legacy frameworks (LlamaIndex) to the structured LangChain framework. It covers code assessment, pattern-by-pattern migration, advanced agent construction, robust tool calling, and transforming custom RAG pipelines into scalable, standardized chains.

Framework for building stateful, multi-actor AI applications with LangGraph, covering graph construction, reducers, persistence, human-in-the-loop patterns, and ReAct agents suitable for Python production systems.

LlamaIndex is a data-centric framework for building LLM applications, offering 300+ connectors, vector indices, query engines, agents, and multimodal support to power document Q&A, chatbots, knowledge retrieval, and RAG pipelines over private data.

An expert guide and framework for building production-grade, sophisticated AI agent systems. This skill specializes in utilizing the latest LangChain 0.1+ and LangGraph APIs to implement multi-agent orchestration, advanced Retrieval-Augmented Generation (RAG) pipelines (e.g., RAG Fusion, HyDE), and complex state management. It covers comprehensive topics from architectural design (Plan-and-Execute, ReAct Agents) to production deployment (FastAPI streaming, LangSmith observability, caching, and robust error handling).