Skill UI

A comprehensive, model-agnostic toolkit for advanced LLM development. It enables iterative prompt optimization through static analysis (token usage, clarity), measures critical RAG metrics (relevance, faithfulness, coverage), and validates complex agent workflows and configurations. Essential for rigorous LLM quality assurance and cost management.

This comprehensive checklist guides the safe and robust deployment of Cohere API v2 integrations from staging to production. It covers critical steps including API key management, code quality standards, performance tuning, implementing health checks and circuit breakers, and defining full rollback procedures, ensuring mission-critical AI features are reliable for launch.

This harness provides comprehensive, reproducible evaluation pipelines for complex LLM chains and agents (LangChain/LangGraph 1.0). It integrates golden dataset management, LangSmith evaluation, RAGAS metrics, deepeval LLM-as-judge, and structured agent trajectory analysis. Use it when establishing quality benchmarks for new chains, diagnosing performance regressions after model switches, or implementing CI/CD gates to prevent quality drops.

A comprehensive reference architecture for building scalable, cost-effective, and robust AI services. This system manages the full AI lifecycle, including intelligent model routing (for quality/cost trade-offs), response caching (using Redis), asynchronous batch processing, and fine-tuning pipeline management via Together AI's OpenAI-compatible API. Ideal for enterprise applications requiring high availability across multiple open-source models.