Skill UI

LlamaGuard is Meta’s 7–8B safety-specialized LLM that filters both prompts and responses by classifying six threat categories, enabling fast inference via vLLM/SageMaker and integration into NeMo Guardrails for end-to-end moderation.

NVIDIA’s NeMo Guardrails adds runtime safety rails to LLM apps, covering jailbreak detection, hallucination and fact-checking, PII filtering, and toxicity checks via Colang 2.0 rules and integrations for production use on T4 GPUs.

This skill outlines the implementation of advanced runtime defenses for production Large Language Model (LLM) applications. It covers using multiple industry-leading guardrail systems—including Llama Guard, NeMo Guardrails, and LLM Guard—to detect and block adversarial attacks such as prompt injection, jailbreaks, and toxic content. It provides a comprehensive defense-in-depth strategy for ensuring model safety and output integrity in real-world deployments.