Skill UI

Track and improve production LLMs with Langfuse observability: trace API calls, manage prompts, score evaluations, integrate with LangChain/LlamaIndex/OpenAI, and keep dashboards on cost, latency, and quality.

Integrate Langfuse into CI/CD pipelines (e.g., GitHub Actions) to automate the testing and validation of Large Language Models (LLMs). This guide covers prompt regression testing, tracing validation, and setting up experiment-driven quality gates, ensuring reliable and high-performing AI applications throughout the development lifecycle.

A comprehensive diagnostic guide for resolving the 10 most common Langfuse integration errors. This resource covers root causes, specific error codes (like 401 Unauthorized or connection timeouts), and provides tested solutions for debugging missing traces, authentication failures, and general LLM observability issues.

Implement comprehensive end-to-end tracing for Large Language Model (LLM) calls, chains, and complex agents using Langfuse. This workflow demonstrates techniques like OpenAI drop-in wrappers, manual span creation for RAG pipelines, tracking streamed responses, and integrating with various LLM providers (OpenAI, Anthropic). Use this to monitor latency, track token usage, and debug complex AI features in production.

A comprehensive workflow for implementing robust LLM evaluation using Langfuse. This skill guides users through key processes including scoring traces (numeric, categorical, boolean), collecting user feedback, managing versioned prompts, creating structured datasets, running automated experiments, and implementing LLM-as-a-Judge patterns for advanced quality assurance and system benchmarking.

Learn how to monitor, analyze, and optimize the expenditure of Large Language Models (LLMs) using Langfuse's advanced analytics suite. This guide covers techniques like automatic token tracking, programmatic cost reporting via the Metrics API, and implementing smart model routing to automatically select the most cost-effective model based on task complexity and input length. Essential for any developer managing AI budgets and ensuring operational efficiency.

This skill provides comprehensive methods for managing the entire data lifecycle of LLM observability platforms like Langfuse. Functions include exporting detailed traces and scores, configuring retention policies (e.g., automatic data cleanup), handling GDPR subject requests (access and erasure), and anonymizing Personally Identifiable Information (PII) for secure analytics. Essential for maintaining regulatory compliance in AI applications.

This bundle collects comprehensive diagnostic evidence for Langfuse support tickets and troubleshooting. It gathers system environment details (Node.js, Python, OS), installed SDK versions, API connectivity status, and redacted application logs. Use this when encountering persistent or complex Langfuse issues to provide full context to support teams.

This comprehensive guide provides step-by-step instructions for integrating Langfuse LLM observability into various cloud and serverless environments. It covers best practices for deployment on platforms such as Vercel, AWS Lambda, Google Cloud Run, and self-hosted Docker, ensuring robust tracing and monitoring of entire AI workflows.

This guide details setting up enterprise-grade access control for Langfuse. Learn how to configure role-based permissions (Owner, Admin, Member), implement scoped API keys, integrate SSO (SAML/OIDC), and set up comprehensive audit logging. It is essential for managing multi-team isolation and ensuring compliance in production environments.

A minimal example demonstrating how to implement basic tracing using the Langfuse SDK. It illustrates the hierarchy of traces, spans, and generations (LLM calls), providing code examples in TypeScript and Python for easy setup and integration testing.

A comprehensive guide for troubleshooting and resolving Langfuse-related incidents and outages. It provides step-by-step procedures for initial triage, severity assessment, implementing fallback modes, and resolving common issues like missing traces or rate limits, ensuring continuous observability monitoring for LLM applications.