Skill UI

This skill set provides advanced, structured strategies for optimizing Large Language Model (LLM) interactions. It covers techniques such as intelligent context summarization, dynamic trimming, context routing, and precise token budget allocation to prevent 'context rot'. It is essential for building robust, long-running, multi-turn conversational AI systems.

A comprehensive pattern for building robust and cost-efficient LLM application pipelines. This guide details combining model routing based on task complexity, immutable cost tracking, limited retry logic, and prompt caching to manage API expenditures while maintaining high quality. Essential for production systems handling variable-complexity, high-volume tasks.

This guide details a production-ready reference architecture for applications built on Groq's LPU inference API. It covers sophisticated model routing based on latency, quality, or cost needs, implementing streaming pipelines, and establishing robust multi-provider fallback chains (e.g., Groq primary to OpenAI backup). Ideal for designing and reviewing complex, resilient LLM systems.

Learn how to monitor, analyze, and optimize the expenditure of Large Language Models (LLMs) using Langfuse's advanced analytics suite. This guide covers techniques like automatic token tracking, programmatic cost reporting via the Metrics API, and implementing smart model routing to automatically select the most cost-effective model based on task complexity and input length. Essential for any developer managing AI budgets and ensuring operational efficiency.

A comprehensive guide for auditing and ensuring regulatory compliance (SOC2, GDPR, HIPAA) when integrating Large Language Models (LLMs) via OpenRouter. It covers best practices for data handling, access control, PII redaction, implementing robust audit trails, and configuring provider routing to maintain data sovereignty and meet strict industry standards.

A comprehensive guide on implementing failover and fallback mechanisms for Large Language Models (LLMs) when using OpenRouter. This skill covers native model fallbacks, provider routing strategies, and advanced client-side fallback chains. Use this pattern when building mission-critical or highly resilient systems that must maintain service availability even if a primary model or an entire provider goes offline. It ensures robust API integration and graceful degradation.

This skill provides comprehensive methods for implementing intelligent model routing using the OpenRouter API. It allows developers to dynamically select the optimal Large Language Model (LLM) based on specific criteria: task complexity (e.g., classification, code generation), required capability (e.g., deep reasoning vs. simple Q&A), cost budget, and latency tolerance. Implement cost-aware, task-based, and complexity-based routing to maximize system efficiency and minimize operational expenses when building multi-model applications.

This skill implements a sophisticated, config-driven rules engine for OpenRouter API calls. It dynamically determines the optimal large language model (LLM) by evaluating a comprehensive context, including user subscription tier, remaining cost budget, specific task type (code, chat), required tools, and latency requirements. This is essential for building production-grade, cost-aware, and robust LLM orchestration systems.

This guide outlines the comprehensive reference architecture for building advanced, AI-powered search and research applications, modeled after Perplexity. It covers three core tiers: a searchable service with model routing and caching, a citation pipeline for validation and rendering, and an orchestrator for multi-query research synthesis. Use this when designing complex, production-grade, search-augmented LLM integrations or reviewing advanced system patterns.

This skill guides the development of EarLLM One, a complex Android application. The app captures real-time audio from Bluetooth earbuds, transcribes the voice using STT, sends the text input to a Large Language Model (LLM) via a robust pipeline, and plays the response back using TTS. It requires deep knowledge of Kotlin, Android development, Bluetooth profiles (A2DP/HFP), and advanced audio routing.

Provides an expert methodology to significantly reduce AI API spending (40-80%) without sacrificing user quality. The guide covers cost auditing, optimizing existing systems, and designing cost-efficient architectures using techniques like model routing, prompt caching, output length control, and prompt compression.

This guide provides comprehensive strategies to significantly reduce spending on the Anthropic Claude API. Key techniques include model routing (selecting the most cost-effective model for the task), prompt caching for repeated prompts, using Message Batches for asynchronous tasks, and implementing real-time spend tracking and budget alerts. Essential for managing large-scale, high-cost AI deployments and optimizing cloud LLM expenditures.