Skill UI

This skill set provides advanced, structured strategies for optimizing Large Language Model (LLM) interactions. It covers techniques such as intelligent context summarization, dynamic trimming, context routing, and precise token budget allocation to prevent 'context rot'. It is essential for building robust, long-running, multi-turn conversational AI systems.

This guide details a production-ready reference architecture for applications built on Groq's LPU inference API. It covers sophisticated model routing based on latency, quality, or cost needs, implementing streaming pipelines, and establishing robust multi-provider fallback chains (e.g., Groq primary to OpenAI backup). Ideal for designing and reviewing complex, resilient LLM systems.

Learn how to monitor, analyze, and optimize the expenditure of Large Language Models (LLMs) using Langfuse's advanced analytics suite. This guide covers techniques like automatic token tracking, programmatic cost reporting via the Metrics API, and implementing smart model routing to automatically select the most cost-effective model based on task complexity and input length. Essential for any developer managing AI budgets and ensuring operational efficiency.

This guide outlines the comprehensive reference architecture for building advanced, AI-powered search and research applications, modeled after Perplexity. It covers three core tiers: a searchable service with model routing and caching, a citation pipeline for validation and rendering, and an orchestrator for multi-query research synthesis. Use this when designing complex, production-grade, search-augmented LLM integrations or reviewing advanced system patterns.

Provides an expert methodology to significantly reduce AI API spending (40-80%) without sacrificing user quality. The guide covers cost auditing, optimizing existing systems, and designing cost-efficient architectures using techniques like model routing, prompt caching, output length control, and prompt compression.

This guide provides comprehensive strategies to significantly reduce spending on the Anthropic Claude API. Key techniques include model routing (selecting the most cost-effective model for the task), prompt caching for repeated prompts, using Message Batches for asynchronous tasks, and implementing real-time spend tracking and budget alerts. Essential for managing large-scale, high-cost AI deployments and optimizing cloud LLM expenditures.

RouterBase acts as a unified, OpenAI-compatible API gateway, allowing applications to route requests across diverse large language models (LLMs) like GPT, Claude, and Gemini. It helps developers migrate existing OpenAI SDK calls, implement sophisticated primary/fallback model selection based on cost, latency, and quality, and manage multimodal payloads (image, audio, video) from a single, standardized endpoint.