Skill UI

A comprehensive security auditing framework designed to systematically detect sensitive information disclosure from Large Language Models (LLMs). It uses multi-phase, escalating dialogue probes to test for leaks such as system prompts, API keys, PII, and internal configurations. Essential for red teaming and rigorous model security assessment.

This guide details the process of deploying production-grade inference services on CoreWeave using KServe. It covers setting up autoscaling, GPU scheduling, and implementing scale-to-zero functionality for efficient ML model serving endpoints. Ideal for MLOps engineers deploying large language models (LLMs) or other complex AI models in a production environment.

A comprehensive evaluation suite designed to benchmark the performance of Large Language Models (LLM) and Vision-Language Models (VLM) specifically for home security applications. It covers 143 diverse tests across 16 critical domains, including tool use, prompt injection resistance, contextual reasoning, alert triage, and detailed scene analysis, ensuring robustness for smart home AI systems.

A comprehensive offensive checklist for assessing the security and robustness of AI and Large Language Model (LLM) applications. It covers advanced adversarial techniques such as prompt injection, jailbreaking, model extraction, data poisoning, and analyzing system vulnerabilities across components. Essential for red-teaming and security assessment.

This workflow guides users through the complete lifecycle of customizing large language models (LLMs). It covers uploading training data, initiating fine-tuning jobs, monitoring training progress, managing model versions, and finally deploying the optimized model to a dedicated, autoscaling inference endpoint using the Together AI API. Ideal for production-level customization.

A comprehensive expert playbook detailing advanced Large Language Model (LLM) prompt injection techniques. Covers direct methods (instruction override, role play), indirect attacks (RAG poisoning, web data manipulation), and sophisticated tool/function calling abuse for data exfiltration and security bypass. Essential for rigorous AI application security testing.

Generates comprehensive, long-form cheat sheets for advanced Machine Learning and Large Language Model (LLM) topics. These tutorials are highly structured, including mathematical derivations, from-scratch PyTorch implementations, detailed comparison tables, and 25 categorized high-frequency interview questions (L1, L2, L3). Ideal for deep academic study and technical interview preparation.

This skill outlines the implementation of advanced runtime defenses for production Large Language Model (LLM) applications. It covers using multiple industry-leading guardrail systems—including Llama Guard, NeMo Guardrails, and LLM Guard—to detect and block adversarial attacks such as prompt injection, jailbreaks, and toxic content. It provides a comprehensive defense-in-depth strategy for ensuring model safety and output integrity in real-world deployments.

This skill utilizes NVIDIA's open-source garak framework to conduct comprehensive red-teaming assessments on Large Language Models (LLMs). It tests for critical vulnerabilities such as prompt injection, jailbreaks, data leakage, and toxic content generation by sending thousands of adversarial probes. Ideal for pre-deployment security validation, API guardrail testing, and generating defensible evidence for AI risk assessments.

A comprehensive guide and skill for deploying large language models (LLMs) locally using the llama.cpp framework and GGUF quantization format. It covers searching the Hugging Face Hub, selecting optimal quantizations (e.g., Q4_K_M), running local servers, and achieving OpenAI-compatible API endpoints. Supports various hardware backends including CPU, Mac Metal, CUDA, and ROCm. Ideal for developers needing offline, private LLM inference.

This skill executes the DeepSWE benchmark, a comprehensive coding-agent evaluation suite. It uses OpenRouter and mini-swe-agent to score various Large Language Models (LLMs) on 113 tasks, providing reproducible results for model comparison, development assessment, and research benchmarking. Use this when a standardized, deep evaluation of LLM coding capabilities is required.

This utility formats prompts for multiple Large Language Model providers (including Anthropic, OpenAI, Gemini, and Ollama) using standardized chat templates. Furthermore, it enables the creation and utilization of an HNSW index for advanced context retrieval, making it ideal for building robust Retrieval-Augmented Generation (RAG) pipelines.