Skill UI

PyRIT (Python Risk Identification Tool) is an open-source automation framework designed for advanced, multi-turn adversarial red-teaming of conversational LLMs. It simulates real-world attack scenarios by orchestrating an attacker model and a scorer model in a feedback loop. Features include Crescendo (gradual escalation) and Tree-of-Attacks with Pruning (TAP) techniques to detect complex vulnerabilities like prompt injection and jailbreaks in stateful dialogues.

This tool assesses whether coding agents adhere to defined skills, rules, or agent definitions. It automatically generates scenarios with varying prompt strictness, executes the agent, and generates a comprehensive report detailing the compliance rate of tool calls against predefined workflow specifications using advanced LLM classification.