Skill UI

A comprehensive evaluation suite designed to benchmark the performance of Large Language Models (LLM) and Vision-Language Models (VLM) specifically for home security applications. It covers 143 diverse tests across 16 critical domains, including tool use, prompt injection resistance, contextual reasoning, alert triage, and detailed scene analysis, ensuring robustness for smart home AI systems.

A comprehensive offensive checklist for assessing the security and robustness of AI and Large Language Model (LLM) applications. It covers advanced adversarial techniques such as prompt injection, jailbreaking, model extraction, data poisoning, and analyzing system vulnerabilities across components. Essential for red-teaming and security assessment.

This skill provides implementation patterns for utilizing Runway's AI video generation and creative platform. It covers setting up the SDK, generating videos from images, and handling common API errors (like insufficient credits or unauthorized access). It is designed for developers needing to integrate secure, high-quality AI video workflows into their applications.

This comprehensive benchmark suite evaluates the performance of Vision-Language Models (VLM) on complex video anomaly detection tasks using the SmartHome-Bench dataset. It covers a wide range of real-world smart home scenarios, including security breaches, elderly fall detection, and unusual pet behavior. Unlike single-frame analysis, this benchmark requires deep multi-frame video understanding, making it a robust tool for testing the advanced AI capabilities of video monitoring systems.