Skill UI

A comprehensive workflow for implementing robust LLM evaluation using Langfuse. This skill guides users through key processes including scoring traces (numeric, categorical, boolean), collecting user feedback, managing versioned prompts, creating structured datasets, running automated experiments, and implementing LLM-as-a-Judge patterns for advanced quality assurance and system benchmarking.

LlamaGuard is Meta’s 7–8B safety-specialized LLM that filters both prompts and responses by classifying six threat categories, enabling fast inference via vLLM/SageMaker and integration into NeMo Guardrails for end-to-end moderation.

This skill provides comprehensive guidance for building production-grade MLOps pipelines. It covers the entire machine learning lifecycle, from initial data ingestion and rigorous feature engineering to model training, advanced validation (A/B testing, performance drift), and robust deployment strategies (Canary, Blue-green). It enables the design and orchestration of scalable, reproducible, and observable ML systems using tools like Airflow and Kubeflow.

This skill provides deep integration with Google NotebookLM, enabling users to query uploaded documentation using Gemini. It ensures source-grounded, citation-backed answers, significantly reducing hallucinations. Features include managing the notebook library (add, list, search), handling authentication, and implementing a structured follow-up mechanism for comprehensive research.

Enables Claude to orchestrate multi-agent systems using AI SDK v5, setting up agents, handoffs, intelligent routing, and workflows across OpenAI, Anthropic, and Google when users request complex agent coordination.

This guide provides comprehensive instructions for deploying applications powered by the Perplexity Sonar API. It covers setup for major cloud platforms like Vercel, Google Cloud Run, and Docker. Users can deploy production-ready endpoints, manage required secrets, implement edge functions, and utilize caching mechanisms (e.g., Redis) to ensure high availability and performance in production environments.

This comprehensive workflow guides the end-to-end implementation of Retrieval-Augmented Generation (RAG) systems. It covers critical stages, including selecting optimal embedding models, setting up vector databases, designing chunking strategies, implementing hybrid retrieval, integrating Large Language Models (LLMs), and performing rigorous evaluation. Use this when building knowledge-grounded AI applications or advanced semantic search systems.

A comprehensive, model-agnostic toolkit for advanced LLM development. It enables iterative prompt optimization through static analysis (token usage, clarity), measures critical RAG metrics (relevance, faithfulness, coverage), and validates complex agent workflows and configurations. Essential for rigorous LLM quality assurance and cost management.

torchforge is Meta's advanced PyTorch-native library designed for agentic Reinforcement Learning (RL). It fundamentally separates core RL algorithms from complex distributed infrastructure concerns. This allows researchers to rapidly prototype and experiment with novel RL methods (like GRPO) using clean, PyTorch-native abstractions, while automatically handling large-scale tasks like distributed training across thousands of GPUs using Monarch and TorchTitan.

TransformerLens is the standard library for performing mechanistic interpretability research on large language models. It provides clean interfaces to inspect and manipulate transformer internals—such as attention patterns, residual streams, and MLP outputs—via activation caching and HookPoints. This tool is essential for reverse-engineering model algorithms, performing causal tracing, and studying the internal circuits responsible for model behavior.

Guides Claude to automatically tune machine learning model hyperparameters via grid, random, or Bayesian search, generating runnable Python code, executing validations, and reporting best configurations plus performance metrics for accuracy or other goals.

This comprehensive guide details the setup and authentication process for the TwinMind AI suite. It covers installing the Chrome extension, setting up mobile applications, integrating with Google/Microsoft calendars, and configuring API access. Use this skill when initializing TwinMind into a professional workflow for automated meeting transcription, note-taking, and data synchronization.