Skill UI

A universal infrastructure for automatically evolving and optimizing AI agents across any domain. Using LLM-driven mutation and iterative solve-observe-evolve cycles, it enhances critical components like prompts, skills, and memory by benchmarking performance against measurable datasets, enabling the creation of self-improving AI systems.

This harness provides comprehensive, reproducible evaluation pipelines for complex LLM chains and agents (LangChain/LangGraph 1.0). It integrates golden dataset management, LangSmith evaluation, RAGAS metrics, deepeval LLM-as-judge, and structured agent trajectory analysis. Use it when establishing quality benchmarks for new chains, diagnosing performance regressions after model switches, or implementing CI/CD gates to prevent quality drops.

This comprehensive skill manages the entire computer vision pipeline, from custom dataset annotation to model deployment. Users can fine-tune YOLO models on proprietary COCO-formatted datasets using an agent-driven workflow. Key features include hardware-aware training (supporting CUDA, MPS, ROCm), automatic export to optimized formats (TensorRT, CoreML, OpenVINO, ONNX), and seamless, one-click deployment as an active detection skill.

A comprehensive guide for diagnosing and resolving slow search performance in Qdrant. This resource covers issues related to low QPS (throughput), high latency for single queries, and slow filtered searches. Solutions include tuning HNSW parameters, managing memory pressure, implementing quantization, optimizing indexing, and configuring cluster settings for maximum efficiency.

This comprehensive guide details advanced workflows for high-quality video generation using platforms like Runway. Learn essential techniques including advanced prompt engineering (Subject + Action + Setting + Style), optimal model selection (e.g., gen4_turbo), and parameter tuning for duration and aspect ratio. The workflow also demonstrates efficient batch generation for creating multiple, consistent video assets.

This guide provides detailed, step-by-step instructions for installing and authenticating the Runway ML SDK. It covers prerequisites for both Python and Node.js environments, including setting up API keys and verifying the connection. This setup is essential for developers who plan to perform high-fidelity AI video generation, image editing, or advanced creative content workflows using the Runway platform.

This skill provides implementation patterns for using the Runway SDK. It enables users to perform advanced creative AI tasks, such as generating videos from text prompts or converting images to video, using the official Python SDK. It covers the full workflow, including setup, task execution, output retrieval, and error handling, making it ideal for creative media automation and advanced video production workflows.

This skill provides implementation patterns for utilizing Runway's AI video generation and creative platform. It covers setting up the SDK, generating videos from images, and handling common API errors (like insufficient credits or unauthorized access). It is designed for developers needing to integrate secure, high-quality AI video workflows into their applications.

This comprehensive benchmark suite evaluates the performance of Vision-Language Models (VLM) on complex video anomaly detection tasks using the SmartHome-Bench dataset. It covers a wide range of real-world smart home scenarios, including security breaches, elderly fall detection, and unusual pet behavior. Unlike single-frame analysis, this benchmark requires deep multi-frame video understanding, making it a robust tool for testing the advanced AI capabilities of video monitoring systems.

This skill provides a production-grade, containerized integration service for connecting to the Together AI platform. It facilitates high-performance inference, fine-tuning, and model deployment across over 100 open-source models using Together's OpenAI-compatible API. Includes comprehensive Docker setup, environment variable management, health checks, and zero-downtime rolling update strategies for robust, real-time LLM serving.

This guide provides comprehensive instructions for setting up and authenticating the Together AI SDK. It covers installation using both Python and Node.js, configuring the necessary API key, and verifying connectivity to utilize the OpenAI-compatible API for powerful open-source model inference and fine-tuning tasks. Ideal for developers starting with Together AI.

This comprehensive checklist guides the operational setup (MLOps) for AI applications using Together AI's OpenAI-compatible API. It covers critical production concerns, including secure API key management, implementing robust rate limit handling, building error resilience features (circuit breakers, exponential backoff), and setting up comprehensive monitoring for latency, cost control, and model availability. Essential for reliable, scalable LLM deployment.