Skill UI

A comprehensive framework for rigorously testing and benchmarking LLM agents. It moves beyond simple pass/fail checks to assess complex behaviors, reliability metrics, and capability consistency across multiple runs. Ideal for production monitoring and identifying subtle failure modes in advanced AI agents.

Covers designing agent tools from schema creation through validation and error handling, emphasizing descriptions that keep LLMs accurate and reusable via MCP standards.

Helps teams ship reliable AI-powered products by detailing LLM integration patterns, RAG architecture, scalable prompt engineering, UX resilience, and cost-aware design.

Activation-aware weight quantization that compresses 7B-70B models to 4-bit with minimal accuracy loss, delivering ~3x inference speedups and memory reductions for constrained GPU deployments while integrating with vLLM and Marlin kernels.

Expert guidance for fine-tuning LLMs with Axolotl, covering YAML configs, LoRA/QLoRA/DPO variants, multimodal support, and practical troubleshooting patterns for development and training workflows.

Expert guidance for fine-tuning LLMs with Axolotl, covering YAML configs, LoRA/QLoRA/DPO variants, multimodal support, and practical troubleshooting patterns for development and training workflows.

Bridges frozen vision encoders and LLMs for high-quality image captioning, VQA, retrieval, and multimodal chat, enabling zero-shot reasoning without fine-tuning and offering efficient Q-Former training.

Chroma is an open-source, AI-native embedding database designed for building sophisticated LLM applications. It allows users to store high-dimensional embeddings and associated metadata, facilitating powerful vector search and full-text filtering. Ideal for implementing Retrieval-Augmented Generation (RAG) systems, semantic search, and document retrieval in local or self-hosted environments, making it perfect for open-source AI projects and prototyping.

A comprehensive guide to understanding the complete state (context) available to Large Language Models during inference. Covers core components like System Prompts, Tool Definitions, Message History, and Retrieval Augmented Generation (RAG). Learning to engineer context is crucial for building robust, efficient, and reliable AI agent systems by managing the attention budget and ensuring high-signal information delivery.

This skill details advanced techniques for enhancing the effective context capacity of LLMs. It outlines four core strategies—Compaction, Observation Masking, KV-Cache Optimization, and Context Partitioning—to prevent context limits from constraining task complexity. By strategically managing token usage, users can reduce operational costs, minimize latency, and implement robust, long-running agent systems for handling large documents or conversations.

This skill set provides advanced, structured strategies for optimizing Large Language Model (LLM) interactions. It covers techniques such as intelligent context summarization, dynamic trimming, context routing, and precise token budget allocation to prevent 'context rot'. It is essential for building robust, long-running, multi-turn conversational AI systems.

Persistent LLM conversation memory that manages short-term, long-term, and entity-focused layers to store, retrieve, and consolidate memorable context for smarter conversational AI agents.