RAMPART

What RAMPART is

RAMPART is a free, open-source framework for writing and running safety and security tests for agentic AI applications. It works within pytest: users connect an agent through an adapter, while RAMPART provides execution strategies, evaluators, test integration, and reporting. Its attack tests mark detected attacks as UNSAFE; behavior probes mark detected expected behavior as SAFE. The documented built-in attack checks cross-prompt injection, including whether malicious content in a data source can affect an agent when retrieved. The built-in probe checks expected responses, tool use, or side effects, making probes useful for regression testing. Results include a SAFE, UNSAFE, UNDETERMINED, or ERROR status, plus trace and evaluation details. RAMPART registers automatically as a pytest plugin and provides harm and trial markers. It creates structured JSON reports, supports custom report sinks, and can combine results from parallel pytest-xdist workers. Installation requires Python 3.11 or later and uses uv or pip on Linux, macOS, or Windows. PyRIT is a dependency; an optional OneDrive extra supports placing XPIA payloads in OneDrive.