Skill UI

A comprehensive workflow for implementing robust LLM evaluation using Langfuse. This skill guides users through key processes including scoring traces (numeric, categorical, boolean), collecting user feedback, managing versioned prompts, creating structured datasets, running automated experiments, and implementing LLM-as-a-Judge patterns for advanced quality assurance and system benchmarking.

This skill guides the design and implementation of a complete, production-grade Machine Learning pipeline. It employs a multi-agent orchestration workflow, systematically covering all stages of the ML lifecycle: data ingestion and quality assurance, feature engineering, model training, optimization, and robust deployment (MLOps). It ensures built-in reproducibility, monitoring, and scalability.

A comprehensive, model-agnostic toolkit for advanced LLM development. It enables iterative prompt optimization through static analysis (token usage, clarity), measures critical RAG metrics (relevance, faithfulness, coverage), and validates complex agent workflows and configurations. Essential for rigorous LLM quality assurance and cost management.

This skill implements an autonomous, multi-round review loop for refining complex research or codebases. It iteratively reviews content using specified external backends (e.g., Codex, manual review), implements necessary fixes based on feedback, and re-reviews until the positive assessment criteria are met or the maximum round limit is reached. It manages state persistence and allows for configurable difficulty levels, making it ideal for projects requiring rigorous, self-correcting quality assurance.

A comprehensive scoring tool to validate localized or translated content before publishing. It calculates a composite score by analyzing technical accuracy (e.g., formatting preservation, placeholder integrity, length ratios), overall content quality, brand voice consistency, and adherence to target market compliance rules. Use this to replace subjective checks with structured, repeatable quality assurance.