Skill UI

A comprehensive framework for rigorously testing and benchmarking LLM agents. It moves beyond simple pass/fail checks to assess complex behaviors, reliability metrics, and capability consistency across multiple runs. Ideal for production monitoring and identifying subtle failure modes in advanced AI agents.

This comprehensive guide outlines essential, production-grade patterns for building robust LangChain applications. Learn best practices for implementing type-safe structured output using Zod, handling provider fallbacks, processing inputs concurrently with batching, optimizing user experience with streaming, and ensuring reliability through caching and retries.

This guide provides comprehensive strategies for optimizing the execution speed, reliability, and cost efficiency of AI agents. Learn how to minimize latency, right-size models (e.g., Flash vs. Opus), consolidate multiple LLM steps into single prompts, and optimize workflow triggers. Ideal for use when agents are slow, consuming excessive credits, or producing inconsistent results.

This skill provides comprehensive patterns for building highly reliable applications that interact with external Large Language Model (LLM) APIs, such as Perplexity Sonar. It implements critical reliability techniques including Circuit Breakers, Model Fallback, Streaming Timeout handling, and Caching layers. Use this to ensure your application maintains high availability and graceful degradation even when external services experience intermittent failures or variable performance.

Guides engineers through advanced prompt engineering techniques to maximize LLM performance, reliability, and controllability across few-shot learning, reasoning patterns, templates, and system prompt design.

This skill provides advanced guidelines for designing robust and effective tools specifically for autonomous AI agents. It shifts the focus from traditional developer APIs to contracts optimized for Language Models (LLMs). Key topics covered include treating tool descriptions as prompt engineering, implementing namespacing, applying the Consolidation Principle, and utilizing Architectural Reduction patterns (like file system access) to maximize agent reliability and workflow complexity.

This skill outlines a comprehensive methodology for designing, building, and deploying robust LLM-powered applications. It covers assessing task-model fit, designing modular pipelines (acquire -> prepare -> process -> parse -> render), and managing state using file systems to ensure scalability and reliability in AI systems.

This methodology converts verbose, natural language system instructions into an atomic, structured-label format (e.g., trigger:, action:). By structuring rules, it bypasses the limitations of natural language processing, ensuring LLMs allocate full attention to every constraint, thereby maximizing compliance, improving reliability, and reducing token usage.

PydanticAI is a robust Python framework that integrates Pydantic's type-checking and validation capabilities into Large Language Models (LLMs). It allows developers to build production-ready AI agents that guarantee structured, validated outputs, moving beyond simple raw strings. Key features include supported tool calling, dependency injection for testability, and multi-model compatibility across major providers like OpenAI, Anthropic, and Gemini. Use this when reliability and correct data structure are paramount.

Automates comprehensive regression testing for all enabled cloud Large Language Model (LLM) providers. This includes verifying core connectivity, standard chat completion, structured JSON output, and Server-Sent Events (SSE) streaming capabilities. Essential for ensuring the reliability and stability of multi-cloud AI integrations in a CI/CD pipeline.

GateGuard is a powerful pre-tool-use hook designed to enhance the reliability of LLM-generated code. Instead of relying on mere self-evaluation, it forces the model to conduct deep, verifiable investigations (such as listing imports, analyzing data schemas, and generating rollback plans) before any code edit, file write, or destructive bash command is executed. This significantly improves code quality and minimizes unexpected bugs in complex codebases.

This tool provides comprehensive AI security scanning using the Tencent AI-Infra-Guard framework. It systematically audits AI infrastructure, scans tools and skills, checks agent security, and performs advanced LLM jailbreak evaluations to identify vulnerabilities and ensure the robustness and reliability of AI systems.