Skill UI

High-performance RLHF framework that combines Ray, vLLM, and ZeRO-3 to accelerate PPO/GRPO/RLOO/DPO training for 7B-70B+ models on distributed GPU clusters, providing a single-stack workflow for reward models and policy optimization.

This skill provides comprehensive strategies for implementing robust caching mechanisms for OpenRouter API calls. It covers in-memory caching using Python, persistent caching with Redis for scalability, and utilizing provider-specific features like Anthropic prompt caching. By implementing deterministic key generation and managing Time-To-Live (TTL), developers can significantly reduce API costs and improve application latency when handling repetitive or similar LLM queries, making it ideal for RAG systems and high-volume applications.

A comprehensive guide for auditing and ensuring regulatory compliance (SOC2, GDPR, HIPAA) when integrating Large Language Models (LLMs) via OpenRouter. It covers best practices for data handling, access control, PII redaction, implementing robust audit trails, and configuring provider routing to maintain data sovereignty and meet strict industry standards.

This skill provides advanced strategies for managing large language model (LLM) context windows and token usage via OpenRouter. Functions include context window lookup, context-aware model selection, conversation trimming, document chunking for RAG, and prompt caching. Use this when dealing with long conversations or large documents to maximize quality while minimizing API costs and preventing context limit overflow.

This skill implements robust data privacy controls for interactions with OpenRouter APIs. It automatically detects and redacts Personally Identifiable Information (PII)—such as emails, SSNs, credit cards, and API keys—from prompts. It ensures compliance with privacy regulations like GDPR and CCPA, allowing developers to safely process sensitive data when using various upstream LLM providers.

A comprehensive guide on implementing failover and fallback mechanisms for Large Language Models (LLMs) when using OpenRouter. This skill covers native model fallbacks, provider routing strategies, and advanced client-side fallback chains. Use this pattern when building mission-critical or highly resilient systems that must maintain service availability even if a primary model or an entire provider goes offline. It ensures robust API integration and graceful degradation.

Implements standardized function/tool calling across various large language models (LLMs) via OpenRouter. This unified approach allows developers to build sophisticated, multi-step agents and complex workflows, regardless of the underlying provider (e.g., GPT-4o, Claude 3.5). It simplifies the process of achieving structured output and tool-augmented reasoning in production systems.

This guide provides a comprehensive quickstart for integrating with OpenRouter, a unified endpoint for accessing multiple large language models (LLMs). It includes examples in cURL, Python, and TypeScript, demonstrating how to send chat completion requests, handle complex JSON responses, manage model parameters, and calculate usage cost across various providers (e.g., Llama, GPT-4o, Claude). Ideal for developers testing API connectivity or building multi-model applications.

This guide provides a comprehensive walkthrough for setting up and authenticating with the OpenRouter API. It covers generating secure API keys, configuring environment variables, and initializing clients in Python and TypeScript. Learn best practices for secure integration, including key management, verification, and key rotation, ensuring reliable connectivity to various large language models (LLMs).

A comprehensive guide detailing common real-world mistakes and pitfalls when integrating with the OpenRouter API. Covers critical best practices for robust LLM deployment, including correct model ID formatting, cost control via max_tokens, secure API key management, handling rate limits, and optimizing client connection reuse. Essential for developers building multi-provider AI applications.

This skill demonstrates advanced techniques for managing high-volume API calls to LLM services via OpenRouter. It implements multi-key round-robin strategies, incorporating health checks and circuit breakers to distribute load across multiple API keys. It also covers concurrent request processing using asyncio and provider-level failover, ensuring high availability and maximizing throughput when facing rate limits.

This skill provides comprehensive tools to monitor the real-time availability, status, and performance of various large language models (LLMs) accessed via OpenRouter. It supports active health probes, catalog checks, and scheduled monitoring via Python and Bash, ensuring robust fault detection and failover logic for production systems that rely on external AI APIs.