Skill UI

A comprehensive CI/CD pipeline designed for LangChain applications. It automates quality assurance through fast, mocked unit tests and slower, more accurate integration tests utilizing real LLMs (e.g., OpenAI). It specifically validates the entire RAG pipeline and integrates tracing with LangSmith, ensuring robust deployment quality.

A comprehensive utility designed to gather all necessary diagnostic evidence for troubleshooting complex LangChain failures. It captures environment snapshots, dependency versions, detailed execution traces (including LLM calls and tool usage), and error stack traces. Use this bundle when preparing detailed GitHub bug reports or conducting LangSmith tracing.

This guide details best practices for configuring LangChain applications across development, staging, and production environments. It ensures strict environment isolation by managing separate API keys, model settings, and LangSmith project names. The setup utilizes Zod for robust validation and integrates secure secret management via GitHub Actions, AWS Secrets Manager, or GCP, guaranteeing reliable and secure deployments.

A comprehensive guide to setting up production-grade observability for LangChain applications. It integrates LangSmith tracing for zero-code debugging, custom callbacks for detailed metric collection (latency, token usage, error rate), and Prometheus exporters for robust alerting. This allows developers to monitor LLM pipelines, track performance metrics, and manage operational health in real-time.

A comprehensive checklist for ensuring LangChain applications are robust, secure, and scalable for production environments. It covers critical areas including configuration management, advanced error handling, observability setup (e.g., LangSmith), performance optimization, security best practices (like prompt injection prevention and PII handling), rigorous testing, and zero-downtime deployment strategies. Use this guide when preparing for a major launch or auditing existing LLM systems.

Provides a deep dive and step-by-step scripts for complex Langfuse migrations. Covers comprehensive data export (traces, scores, prompts, datasets) and import processes. This guide is essential for platform transitions, moving between different Langfuse instances, or migrating from observability tools like LangSmith, supporting zero-downtime dual-write patterns.

Fetch execution traces from LangSmith Studio to inspect LangChain/LangGraph agent runs, analyze errors, tool calls, memory usage, and performance, and export sessions for deeper diagnostics using the langsmith-fetch CLI.

LangSmith centralizes tracing, evaluation, and monitoring for LLM applications, letting teams debug prompts, run regression tests, collect latency/cost metrics, and integrate with OpenAI, Anthropic, LangChain, or LlamaIndex to keep production systems observable.

An expert guide and framework for building production-grade, sophisticated AI agent systems. This skill specializes in utilizing the latest LangChain 0.1+ and LangGraph APIs to implement multi-agent orchestration, advanced Retrieval-Augmented Generation (RAG) pipelines (e.g., RAG Fusion, HyDE), and complex state management. It covers comprehensive topics from architectural design (Plan-and-Execute, ReAct Agents) to production deployment (FastAPI streaming, LangSmith observability, caching, and robust error handling).

This harness provides comprehensive, reproducible evaluation pipelines for complex LLM chains and agents (LangChain/LangGraph 1.0). It integrates golden dataset management, LangSmith evaluation, RAGAS metrics, deepeval LLM-as-judge, and structured agent trajectory analysis. Use it when establishing quality benchmarks for new chains, diagnosing performance regressions after model switches, or implementing CI/CD gates to prevent quality drops.

This skill integrates LangChain 1.0 and LangGraph 1.0 into standard OpenTelemetry (OTEL) backends (e.g., Jaeger, Honeycomb, Tempo). It solves critical observability gaps by ensuring correct prompt content capture, propagating spans across complex subgraphs, and providing five LLM-specific Service Level Objectives (SLOs) like latency and cost. Ideal for multi-tenant, compliance-sensitive, or existing OTEL stack environments where LangSmith is unsuitable.

This skill provides advanced techniques for robust prompt engineering within LangChain applications. It solves common production issues, such as f-string template breakage when user input contains literal curly braces, and guides developers on consolidating scattered prompts. Crucially, it details how to use the LangSmith Prompt Hub to version, pin, and A/B test prompts using immutable commit hashes, ensuring stable, reproducible LLM deployments.