Skill UI

A comprehensive framework for rigorously testing and benchmarking LLM agents. It moves beyond simple pass/fail checks to assess complex behaviors, reliability metrics, and capability consistency across multiple runs. Ideal for production monitoring and identifying subtle failure modes in advanced AI agents.

A sophisticated hybrid memory system designed specifically for AI agents. It provides a persistent, searchable knowledge bank to store, retrieve, and manage long-term knowledge, including architectural designs, operational patterns, and critical decision points. By syncing with project documentation, it ensures that crucial institutional knowledge remains accessible throughout the development lifecycle, enhancing agent reliability and consistency.

A systematic workflow designed to significantly improve the reliability and performance of existing AI agents. It covers detailed performance analysis, including gathering metrics (e.g., task success rate, latency), classifying failure modes, and advanced prompt engineering techniques (like Chain-of-Thought and Constitutional AI). The process culminates in structured A/B testing and controlled deployment, ensuring measurable, robust improvements.

An advanced AI-driven framework for holistic performance engineering of multi-agent systems. It provides coordinated profiling, workload distribution, and cost-aware orchestration across various domains (database, application, frontend). Use this tool to identify bottlenecks, improve throughput, enhance reliability, and manage resource constraints in complex agent workflows.

Formal evaluation framework for Claude Code sessions that applies evaluation-driven development to define capability and regression checks, run deterministic and model graders, and track pass@k/pass^k reliability metrics before shipping.

Generates complete, production-ready Google Cloud Platform (GCP) code examples and infrastructure templates. It spans various modern AI patterns, including ADK agents, Genkit RAG flows, and multimodal analysis using Vertex AI and Gemini. The output includes runnable code, deployment configuration (Terraform/IaC), security best practices (IAM, VPC-SC), and monitoring setup, ensuring enterprise-grade reliability and cost optimization.

A production-ready Python SDK providing comprehensive patterns for integrating with the Kling AI API. This wrapper handles crucial operational complexities such as auto-refreshing JWT tokens, structured request/response models, exponential backoff polling for long-running tasks, and detailed error handling. Use this library when building stable, high-reliability applications that require advanced text-to-video or image-to-video synthesis capabilities.

This guide provides comprehensive strategies for optimizing the execution speed, reliability, and cost efficiency of AI agents. Learn how to minimize latency, right-size models (e.g., Flash vs. Opus), consolidate multiple LLM steps into single prompts, and optimize workflow triggers. Ideal for use when agents are slow, consuming excessive credits, or producing inconsistent results.

Automate the validation and testing of prompts and AI responses within your CI/CD pipeline using Mistral AI. This integration provides robust prompt regression testing, model quality checks, automatic cost estimation for API usage, and deployment gates, ensuring the stability and reliability of your AI features upon every pull request.

A comprehensive toolkit designed to manage the complex data flow associated with Perplexity search workflows. This skill implements critical security measures, including PII sanitization in user queries, validates external citations for accuracy, optimizes performance via result caching with freshness policies, and manages conversation context to maintain coherence and reliability. Essential for building robust, compliance-aware AI applications.

This guide implements comprehensive guardrails for Perplexity Sonar API. It covers crucial aspects like query content moderation, PII sanitization, enforcing user usage quotas, selecting appropriate models based on user tiers, and scoring citation reliability to ensure safe, ethical, and cost-effective AI usage.

Guides engineers through advanced prompt engineering techniques to maximize LLM performance, reliability, and controllability across few-shot learning, reasoning patterns, templates, and system prompt design.