Skill UI

LlamaGuard is Meta’s 7–8B safety-specialized LLM that filters both prompts and responses by classifying six threat categories, enabling fast inference via vLLM/SageMaker and integration into NeMo Guardrails for end-to-end moderation.

NVIDIA’s NeMo Guardrails adds runtime safety rails to LLM apps, covering jailbreak detection, hallucination and fact-checking, PII filtering, and toxicity checks via Colang 2.0 rules and integrations for production use on T4 GPUs.

This framework implements robust guardrails for LLM applications, validating both user inputs and model outputs. It detects prompt injection, sensitive PII (Personally Identifiable Information), toxic content, and ensures structured output compliance using advanced tools like NVIDIA NeMo Guardrails and Guardrails AI. Essential for building secure, reliable chatbots and RAG systems.

Implements a comprehensive defense-in-depth framework for autonomous AI agents that interact with external tools. It mitigates risks like prompt injection or tool misuse by enforcing strict tool allowlisting, binding tools to least-privilege identities, requiring human-in-the-loop approval for high-impact actions, and utilizing policy enforcement (like NeMo Guardrails) to bound the blast radius and ensure compliance.

Runs reproducible LLM evaluations across 100+ benchmarks and 18+ harnesses with Docker, Slurm HPC, and cloud backends.