Skill UI

High-performance RLHF framework that combines Ray, vLLM, and ZeRO-3 to accelerate PPO/GRPO/RLOO/DPO training for 7B-70B+ models on distributed GPU clusters, providing a single-stack workflow for reward models and policy optimization.

This skill provides comprehensive strategies for implementing robust caching mechanisms for OpenRouter API calls. It covers in-memory caching using Python, persistent caching with Redis for scalability, and utilizing provider-specific features like Anthropic prompt caching. By implementing deterministic key generation and managing Time-To-Live (TTL), developers can significantly reduce API costs and improve application latency when handling repetitive or similar LLM queries, making it ideal for RAG systems and high-volume applications.

This comprehensive guide helps users diagnose and fix common OpenRouter API errors, including authentication failures (401), rate limiting (429), and bad requests (400). It provides a complete reference table, detailed root causes, and executable code examples in Bash and Python to ensure stable API integration and robust error handling.

This skill provides advanced strategies for managing large language model (LLM) context windows and token usage via OpenRouter. Functions include context window lookup, context-aware model selection, conversation trimming, document chunking for RAG, and prompt caching. Use this when dealing with long conversations or large documents to maximize quality while minimizing API costs and preventing context limit overflow.

A comprehensive guide on implementing failover and fallback mechanisms for Large Language Models (LLMs) when using OpenRouter. This skill covers native model fallbacks, provider routing strategies, and advanced client-side fallback chains. Use this pattern when building mission-critical or highly resilient systems that must maintain service availability even if a primary model or an entire provider goes offline. It ensures robust API integration and graceful degradation.

A comprehensive guide detailing common real-world mistakes and pitfalls when integrating with the OpenRouter API. Covers critical best practices for robust LLM deployment, including correct model ID formatting, cost control via max_tokens, secure API key management, handling rate limits, and optimizing client connection reuse. Essential for developers building multi-provider AI applications.

This skill demonstrates advanced techniques for managing high-volume API calls to LLM services via OpenRouter. It implements multi-key round-robin strategies, incorporating health checks and circuit breakers to distribute load across multiple API keys. It also covers concurrent request processing using asyncio and provider-level failover, ensuring high availability and maximizing throughput when facing rate limits.

This skill provides a comprehensive guide to understanding OpenRouter's API billing structure. It teaches users how to accurately calculate costs based on prompt (input) and completion (output) tokens. Users can utilize provided scripts to estimate costs, check credit balances, and implement cost-saving strategies like using `:floor` or `:free` model variants. Ideal for budgeting, performance comparison, and production cost tracking.

A comprehensive guide on handling API rate limits and throttling errors (429) when building high-throughput systems, particularly for LLM APIs like OpenRouter. This skill covers best practices, including using exponential backoff, implementing custom client-side rate limiters (Token Bucket), and managing concurrent requests for stable, reliable performance.

Provides comprehensive patterns for creating production-grade client wrappers when integrating with OpenRouter via the OpenAI SDK. This skill covers handling advanced topics such as robust retry mechanisms, structured typing, caching strategies, and middleware implementation. It is essential for developers building stable, reliable SDKs or commercial client libraries that require enterprise-level API robustness.

This skill provides comprehensive guides on implementing real-time streaming responses using OpenRouter's Server-Sent Events (SSE) capability. It covers various languages (Python, TypeScript, FastAPI, JavaScript), enabling developers to build modern, fast-feeling chat interfaces. By streaming tokens as they are generated, it significantly reduces the time-to-first-token (TTFT) and improves user experience for long completions and chat applications.

This skill provides comprehensive governance for multi-user API deployments using OpenRouter. It covers key provisioning, including creating, listing, and revoking individual user keys. Users can set per-user budget limits and track usage costs programmatically. It is designed for corporate or team environments that require strict cost control, usage attribution, and detailed usage reporting.