Skill UI

This guide provides advanced techniques for optimizing Mistral AI API usage, focusing on latency reduction and throughput maximization. Learn to implement robust caching strategies, utilize streaming responses (SSE), select the optimal model for specific use cases (e.g., Mistral Small for chat, Codestral for code), manage concurrent requests using rate limiting, and efficiently use the Batch API. Essential for building high-performance, production-grade AI applications.

Master building robust AI workflows with Anthropic's core APIs. This guide details two powerful patterns: real-time streaming via SSE events for interactive chat UIs, and the cost-efficient Message Batches API for asynchronously processing up to 100,000 requests. Includes comprehensive code examples for Python and TypeScript.

Implements robust rate limiting, backoff logic, and quota management for the Anthropic Claude API. It handles 429 errors and optimizes request throughput by managing Requests Per Minute (RPM), Input Tokens Per Minute (ITPM), and Output Tokens Per Minute (OTPM). This skill provides advanced strategies including SDK retries, custom header awareness, queue-based throttling, and batch processing for stable, high-throughput production applications.

Utilize Anthropic Message Batches API for high-volume, asynchronous bulk processing of AI tasks. This method allows processing up to 10,000 requests per batch, ideal for summarizing large document sets or running repetitive tasks where immediate, synchronous results are not required. The process involves creating the batch, polling for status completion (within 24 hours SLA), and then retrieving detailed results, including success and error statuses for each item.

Provides a hardened FastAPI endpoint for OpenMed's core functionalities: clinical Named Entity Recognition (NER), Personally Identifiable Information (PII) extraction, and de-identification. Designed for self-hosted microservices, it handles inference requests, model lifecycle management, and supports dynamic batching, ensuring secure, on-device processing of sensitive clinical data.

This skill evaluates supplied outputs against explicit criteria, including code-change reviews and authorized safety evaluations. It supports evidence-backed review leads, rubric judgments, and batch transcript evaluation for existing outputs or observed behavior. It helps users judge results without merging or running targets. Suitable for design requests, code reviews, and safety workflows. Users can choose real API calls or simulation modes for independent outcome validation.