AI Verify

C
C tier on AI Governance SoftwareScore 6.4 · #6 of 56
Android app
Not listed
Free plan
No
Runs on
api, Linux, self-hosted, Web
aiverifyfoundation.sg
The AI Verify homepage

Summary

AI Verify is an open-source toolkit for assessing AI systems, with tests for fairness, explainability, and robustness in traditional machine-learning models. Users can run tests through a Portal or command line, upload results, complete process checklists, and generate standard or customized reports. AIVT 2.0 accepts tabular and image data, using a model file, preprocessing pipeline, or model API as input. Plugins extend the toolkit, while Veritas adds fairness and transparency testing for threshold trade-offs and explainability plots. Its broader framework assesses responsible implementation against 11 AI-governance principles and maps to frameworks and standards including NIST AI RMF and ISO/IEC 42001. Project Moonshot is a separate tool for assessing LLM applications through benchmarking and red teaming. The Toolkit is available under the Apache 2.0 license, and supports web, command-line, and self-hosted use. AI Verify does not set ethical standards or guarantee tested systems are risk-free, unbiased, or completely safe.

Who it is for

It is aimed at data-science and compliance users, as well as AI owners, developers, researchers, service providers, and companies integrating the toolkit into their systems. It supports both self-assessment and third-party testing.

What is good

  • Offers technical tests for fairness, explainability, and robustness.
  • Runs through a Portal or command line.
  • Accepts tabular and image data.
  • Supports plugins and customized reports.
  • Apache 2.0 license permits open-source use.

What to know first

  • Toolkit tests traditional AI, not LLM applications.
  • Does not define ethical standards or guarantee safety.
  • AIVT 2.0 supports tabular and image data types.

Everything Xiaomi review

AI Verify: the full review

AI Verify provides a structured way to test traditional AI systems and produce reports against governance principles. It can inform assessment, but cannot certify that a system is safe or free from bias.

Overview

AI Verify combines a testing toolkit for traditional machine-learning systems with a broader framework for assessing responsible AI implementation. Its technical tests focus on fairness, explainability and robustness, while the framework organizes governance work around 11 internationally recognized principles. These include transparency, safety, security, data governance and accountability.

The framework covers traditional and generative AI and aligns with principles and frameworks from the EU, OECD and Singapore. It is also mapped to the NIST AI Risk Management Framework, its Generative AI Profile, the Hiroshima Process Code of Conduct and ISO/IEC 42001. These are reference points for assessment, not ethical standards defined by AI Verify itself.

AI Verify is maintained by a not-for-profit foundation wholly owned by Singapore’s Infocomm Media Development Authority. Founded in 2022, the Foundation offers the toolkit under the Apache 2.0 permissive license. AI Verify does not promise that a system is free of risks or bias, or completely safe; its tests and framework are aids to assessment rather than guarantees.

Key features

Testing and workflow

The AI Verify Testing Toolkit provides more than eight technical tests for traditional AI applications, covering fairness, explainability and robustness. Users can run tests through a Portal or command line, upload results, complete process checklists and generate reports. The toolkit supports both third-party testing and self-assessment, and reports can bring together work from developers and compliance teams.

Data, inputs and extensions

AIVT 2.0 supports tabular and image data. Tests can use a model file, a preprocessing pipeline or a model API as input. The toolkit can also be extended with plugins developed by the AI Verify Foundation or third parties.

Veritas, one listed integration, adds fairness and transparency testing for threshold trade-offs, along with explainability plots. Its integration is intended to help financial institutions address common safety-baseline and financial-testing requirements from MAS.

Governance and reporting

Standard report templates set out report layouts, technical tests and process checks in advance, and users can also customize reports. The framework provides a structure for assessing responsible implementation against its 11 principles, but does not prescribe ethical standards or certify that a system is safe.

AI Verify is distinct from Project Moonshot: the Testing Toolkit evaluates traditional AI applications, while Moonshot assesses applications built on large language models through benchmarks and red teaming. Moonshot implements benchmarks recommended in IMDA’s Starter Kit and offers a Web UI, interactive CLI, library APIs and Web APIs for MLOps integration.

Pricing

AI Verify is free. Its free plan is listed as the pricing option.

Platforms

AI Verify is listed for API, Linux, self-hosted and web use, with on-premises deployment available. The Portal and command-line workflow offer two ways to run tests. The stated AIVT 2.0 data support is limited to tabular and image data.

Who it's for

The framework and toolkit are available to anyone, including AI owners, developers, researchers, service providers and companies integrating them into their systems. The toolkit is particularly suited to data-science and compliance users who need to conduct or review technical tests and governance checks. Its support for both self-assessment and third-party testing gives those groups options for organizing evaluation work.

Teams looking for an AI system inventory should note that AI Verify is not listed as providing one. Risk assessments and policy and controls are listed, as are the AI Verify Testing Framework and several compliance-framework mappings.

Pros and cons

Pros

  • Free, open-source toolkit released under the Apache 2.0 license.
  • More than eight technical tests address fairness, explainability and robustness.
  • Portal and command-line workflows support uploads, process checklists and report generation.
  • Customizable reports and extensible plugins accommodate different evaluation workflows.
  • The governance framework maps to recognized regional and international principles and standards.

Cons

  • AIVT 2.0 currently supports tabular and image data, and its technical tests focus on traditional AI applications.
  • AI Verify does not set ethical standards or guarantee systems are risk-free, unbiased or completely safe.
  • Project Moonshot, rather than the Testing Toolkit, is the Foundation’s tool for testing LLM-based applications.
  • No AI system inventory is listed.

Alternatives

For other options in this category, see our AI Governance Software list. Alternatives include AIGovernr, Trusys AI, Verisum, Prufer, SAS Visual Statistics, Grasp, Deeploy and OneTrust Third-Party Management.

Verdict

AI Verify is a practical free option for teams that want an open toolkit for testing traditional AI systems and a separate framework for organizing governance assessments. Its multiple test workflows, report options and plugin support provide flexibility, while the stated data coverage and technical focus set clear boundaries. It is best treated as one part of an evaluation process: it can structure checks and reporting, but it cannot establish ethical standards or guarantee that an AI system is safe.

Compared on AI governance software

Free plan
Yesaiverifyfoundation.sg
AI system inventory
Noaiverifyfoundation.sg
Risk assessments
Yesaiverifyfoundation.sg
Policy and controls
Yesaiverifyfoundation.sg
Compliance frameworks
AI Verify Testing Framework; NIST AI RMF; NIST AI RMF Generative AI Profile; Hiroshima Process Code of Conduct; ISO/IEC 42001aiverifyfoundation.sg
Deployment options
on-premisesaiverifyfoundation.sg
Listed integrations
Veritasaiverifyfoundation.sg

Facts

Purpose
AI Verify is an open-source, extensible toolkit that validates AI-system performance.aiverify-foundation.github.io · 1 Oct 2026
Testing coverage
The toolkit provides more than eight technical tests for fairness, explainability and robustness.aiverify-foundation.github.io · 1 Oct 2026
Users
It is built for data-science and compliance users, and supports both third-party testing and self-assessment.aiverify-foundation.github.io · 1 Oct 2026
Framework principles
The framework contains 11 AI-ethics principles, including transparency, explainability, safety, security, robustness, fairness, data governance and accountability.aiverifyfoundation.sg · 1 Oct 2026
International alignment
The framework is aligned with internationally recognised principles and frameworks from the EU, OECD and Singapore.aiverifyfoundation.sg · 1 Oct 2026
Portal and CLI
Users can run tests through the Portal or command line, upload results, complete process checklists and generate reports.aiverify-foundation.github.io · 1 Oct 2026
Data support
AIVT 2.0 currently supports tabular and image data types and can use a model file, preprocessing pipeline or model API as input.aiverify-foundation.github.io · 1 Oct 2026
Extensibility
The toolkit supports plugins built by the AI Verify Foundation or third parties.aiverify-foundation.github.io · 1 Oct 2026
Veritas integration
Veritas integration adds fairness and transparency tests for threshold trade-offs plus explainability plots.aiverify-foundation.github.io · 1 Oct 2026
Reporting
AI Verify includes standard report templates that predefine report layouts, technical tests and process checks, while also allowing customized reports.aiverify-foundation.github.io · 1 Oct 2026
License
The toolkit is open-sourced under the Apache 2.0 permissive license.aiverifyfoundation.sg · 1 Oct 2026
Security
The Foundation says electronic storage and transmission of personal data are secured with appropriate security technologies.aiverifyfoundation.sg · 1 Oct 2026
Scope limit
Project Moonshot tests LLM-based applications, while the AI Verify Testing Toolkit tests traditional AI applications for fairness, explainability and robustness.aiverifyfoundation.sg · 1 Oct 2026
Foundation status
AI Verify Foundation is a not-for-profit, wholly owned subsidiary of Singapore’s Infocomm Media Development Authority.aiverifyfoundation.sg · 1 Oct 2026
Framework coverage
The framework assesses responsible implementation against 11 internationally recognised AI-governance principles and covers traditional and generative AI.aiverifyfoundation.sg · 2 Oct 2026
Standards alignment
The framework is mapped to NIST AI RMF, NIST AI RMF Generative AI Profile, Hiroshima Process Code of Conduct and ISO/IEC 42001.aiverifyfoundation.sg · 2 Oct 2026
Traditional AI tests
The Toolkit provides technical tests for fairness, explainability and robustness of traditional machine-learning models.aiverifyfoundation.sg · 2 Oct 2026
Reports
The Toolkit creates customised reports and can combine independent developer and compliance-team work into a full report.aiverifyfoundation.sg · 2 Oct 2026
Open source
The Toolkit is open-sourced under the permissive Apache 2.0 license.aiverifyfoundation.sg · 2 Oct 2026
Who can use it
Anyone can use the AI Verify Testing Framework and Toolkit, including AI owners, developers, researchers, service providers and companies integrating it into their systems.aiverifyfoundation.sg · 2 Oct 2026
Integration
Veritas was integrated into AI Verify to help financial institutions meet common safety-baseline and financial-testing requirements from MAS.aiverifyfoundation.sg · 2 Oct 2026
Generative AI tool
Project Moonshot assesses LLM applications through benchmark testing and red teaming and implements benchmarks recommended in IMDA's Starter Kit.aiverifyfoundation.sg · 2 Oct 2026
Moonshot interfaces
Project Moonshot offers a Web UI, interactive CLI, library APIs and Web APIs for MLOps integration.github.com · 2 Oct 2026
Limitation
AI Verify does not define AI ethical standards and does not guarantee that tested systems are free from risks or biases or completely safe.github.com · 2 Oct 2026
Support
Users are directed to GitHub discussions, the issue tracker, documentation and the Foundation contact page for assistance.github.com · 2 Oct 2026

Company

Founded
2022aiverifyfoundation.sg · 28 Sept 2026
Headquarters
Singaporeaiverifyfoundation.sg · 28 Sept 2026

Best AI Verify alternatives

See all 20

Where it ranks on Everything Xiaomi

Is AI Verify yours?

Claim it for free: prove the domain, then correct facts, plans and screenshots. An editor reviews every change.

Sources