Skill UI

Provides comprehensive guides for installing the LangChain SDK in both Python and Node.js environments. Covers the necessary steps to set up core packages and securely configure API keys for major LLM providers like OpenAI, Anthropic, and Google, enabling immediate development of complex AI applications.

This comprehensive guide walks developers through migrating complex LLM codebases from raw SDK calls (OpenAI, Anthropic) or legacy frameworks (LlamaIndex) to the structured LangChain framework. It covers code assessment, pattern-by-pattern migration, advanced agent construction, robust tool calling, and transforming custom RAG pipelines into scalable, standardized chains.

A comprehensive guide to setting up production-grade observability for LangChain applications. It integrates LangSmith tracing for zero-code debugging, custom callbacks for detailed metric collection (latency, token usage, error rate), and Prometheus exporters for robust alerting. This allows developers to monitor LLM pipelines, track performance metrics, and manage operational health in real-time.

A comprehensive checklist for ensuring LangChain applications are robust, secure, and scalable for production environments. It covers critical areas including configuration management, advanced error handling, observability setup (e.g., LangSmith), performance optimization, security best practices (like prompt injection prevention and PII handling), rigorous testing, and zero-downtime deployment strategies. Use this guide when preparing for a major launch or auditing existing LLM systems.

This comprehensive skill implements advanced event-driven patterns for LangChain applications. It provides custom callback handlers to observe every stage of chain execution (e.g., tool start/end, LLM token generation). Furthermore, it supports real-time data transmission via Server-Sent Events (SSE) and WebSockets, and integrates webhooks for centralized event logging and comprehensive tracing.

Track and improve production LLMs with Langfuse observability: trace API calls, manage prompts, score evaluations, integrate with LangChain/LlamaIndex/OpenAI, and keep dashboards on cost, latency, and quality.

Integrate Langfuse into CI/CD pipelines (e.g., GitHub Actions) to automate the testing and validation of Large Language Models (LLMs). This guide covers prompt regression testing, tracing validation, and setting up experiment-driven quality gates, ensuring reliable and high-performing AI applications throughout the development lifecycle.

Implement comprehensive end-to-end tracing for Large Language Model (LLM) calls, chains, and complex agents using Langfuse. This workflow demonstrates techniques like OpenAI drop-in wrappers, manual span creation for RAG pipelines, tracking streamed responses, and integrating with various LLM providers (OpenAI, Anthropic). Use this to monitor latency, track token usage, and debug complex AI features in production.

A comprehensive workflow for implementing robust LLM evaluation using Langfuse. This skill guides users through key processes including scoring traces (numeric, categorical, boolean), collecting user feedback, managing versioned prompts, creating structured datasets, running automated experiments, and implementing LLM-as-a-Judge patterns for advanced quality assurance and system benchmarking.

Learn how to monitor, analyze, and optimize the expenditure of Large Language Models (LLMs) using Langfuse's advanced analytics suite. This guide covers techniques like automatic token tracking, programmatic cost reporting via the Metrics API, and implementing smart model routing to automatically select the most cost-effective model based on task complexity and input length. Essential for any developer managing AI budgets and ensuring operational efficiency.

Fetch execution traces from LangSmith Studio to inspect LangChain/LangGraph agent runs, analyze errors, tool calls, memory usage, and performance, and export sessions for deeper diagnostics using the langsmith-fetch CLI.

LangSmith centralizes tracing, evaluation, and monitoring for LLM applications, letting teams debug prompts, run regression tests, collect latency/cost metrics, and integrate with OpenAI, Anthropic, LangChain, or LlamaIndex to keep production systems observable.