PyRIT

What PyRIT is

PyRIT is a free, open-source framework for security professionals and engineers evaluating risks in generative AI systems. It supports single-turn and multi-turn red-team strategies, including Crescendo, TAP, and Skeleton Key, and repeatable scenario evaluations across hundreds of objectives such as content harms, psychosocial risks, and data leakage. CoPyRIT provides a web interface for interacting with AI systems, tracking findings, and collaborating with a team. Documented targets include OpenAI, Azure, Anthropic, Google, HuggingFace, custom HTTP endpoints and WebSockets, and web apps tested with Playwright. PyRIT can store conversations, scores, and attack results in SQLite or Azure SQL, and export results. Scoring supports true/false, Likert scale, classification, and custom scorers, including LLM-based and Azure AI Content Safety scoring. The documentation describes Scanner, GUI, and Framework modes, including command-line assessment via pyrit_scan and pyrit_shell. It can be installed with Docker or locally using pip or uv; local installation documentation recommends Python 3.13. The project is MIT licensed.