Skill UI

This skill set provides advanced, structured strategies for optimizing Large Language Model (LLM) interactions. It covers techniques such as intelligent context summarization, dynamic trimming, context routing, and precise token budget allocation to prevent 'context rot'. It is essential for building robust, long-running, multi-turn conversational AI systems.

This guide details a production-ready reference architecture for applications built on Groq's LPU inference API. It covers sophisticated model routing based on latency, quality, or cost needs, implementing streaming pipelines, and establishing robust multi-provider fallback chains (e.g., Groq primary to OpenAI backup). Ideal for designing and reviewing complex, resilient LLM systems.

Learn how to monitor, analyze, and optimize the expenditure of Large Language Models (LLMs) using Langfuse's advanced analytics suite. This guide covers techniques like automatic token tracking, programmatic cost reporting via the Metrics API, and implementing smart model routing to automatically select the most cost-effective model based on task complexity and input length. Essential for any developer managing AI budgets and ensuring operational efficiency.

This skill provides comprehensive guidance on training Mixture of Experts (MoE) models, including architectures like Mixtral and DeepSeek-V3. It details techniques for achieving large-scale model capacity with significantly reduced computational costs (e.g., 5x reduction vs. dense models). Topics covered include top-k routing, load balancing, expert parallelism, and integration with frameworks like DeepSpeed and HuggingFace for efficient, resource-constrained training.

This guide outlines the comprehensive reference architecture for building advanced, AI-powered search and research applications, modeled after Perplexity. It covers three core tiers: a searchable service with model routing and caching, a citation pipeline for validation and rendering, and an orchestrator for multi-query research synthesis. Use this when designing complex, production-grade, search-augmented LLM integrations or reviewing advanced system patterns.

Provides an expert methodology to significantly reduce AI API spending (40-80%) without sacrificing user quality. The guide covers cost auditing, optimizing existing systems, and designing cost-efficient architectures using techniques like model routing, prompt caching, output length control, and prompt compression.

This guide provides comprehensive strategies to significantly reduce spending on the Anthropic Claude API. Key techniques include model routing (selecting the most cost-effective model for the task), prompt caching for repeated prompts, using Message Batches for asynchronous tasks, and implementing real-time spend tracking and budget alerts. Essential for managing large-scale, high-cost AI deployments and optimizing cloud LLM expenditures.

A comprehensive reference architecture for building scalable, cost-effective, and robust AI services. This system manages the full AI lifecycle, including intelligent model routing (for quality/cost trade-offs), response caching (using Redis), asynchronous batch processing, and fine-tuning pipeline management via Together AI's OpenAI-compatible API. Ideal for enterprise applications requiring high availability across multiple open-source models.

This utility handles asynchronous webhook events from Together AI, enabling developers to build robust, event-driven Machine Learning pipelines. Instead of constantly polling the API for status updates (e.g., fine-tuning completion, batch job status, model deprecation), you can subscribe to these webhooks. It includes logic for signature verification, event routing, and idempotency, making it ideal for mission-critical AI workflows.

A sophisticated system designed to automatically select the optimal AI agent and model tier (e.g., Haiku, Sonnet, Opus) for any non-trivial task. It replaces manual decision-making by integrating learned patterns, predictive modeling, and a robust 3-tier routing mechanism. The process is fully auditable, providing a detailed routing rationale to ensure transparency and reliable execution.

RouterBase acts as a unified, OpenAI-compatible API gateway, allowing applications to route requests across diverse large language models (LLMs) like GPT, Claude, and Gemini. It helps developers migrate existing OpenAI SDK calls, implement sophisticated primary/fallback model selection based on cost, latency, and quality, and manage multimodal payloads (image, audio, video) from a single, standardized endpoint.

This skill helps authors strategically decide the optimal venue for their Language Model research. It provides the critical "object-of-study test" to determine if the LM itself is the subject of the study, or merely a tool for a task. Furthermore, it guides routing against top-tier NLP/AI conferences (ACL, NeurIPS, ICLR, etc.), helping authors target the right audience and maximizing submission chances.