EVERYTHING XIAOMI
Get listed
Ranked chart · AI Tools

Best AI Model Explainability Software in 2026

Arthur leads this chart of 29 (6.7/10, free plan). Arize AI is next (6.6/10, free plan), and Aequitas is the next highest-placed with a free plan (6.4/10). AI model explainability software helps you inspect how a model reaches a prediction. Category comparisons cover feature attribution, counterfactual explanations, fairness analysis, audit reports, deployment options and supported model types. Check Android support before choosing a tool for a phone or tablet. Listed platforms include Linux, macOS, Windows, web, API and self-hosted setups; also compare free access,…

29 appsSorted 14 Nov 2026How we rank
16.7
Arthur logo

Arthur is a platform for finding AI agents across enterprise environments and providing a shared way to observe and govern them.

Free planWebAPISelf-hosted
From $60 a month
  1. 4Fiddler AI logo

    Fiddler AI

    Free planWebAPISelf-hosted
    6.4Free plan
  2. 5

    AIX360

    Free planAPILinuxmacOSSelf-hosted
    6.2Free plan
  3. 6

    Captum

    Free planLinuxmacOSSelf-hostedWindows
    6.0Free plan
  4. 7

    Alibi

    Free planAPILinuxSelf-hosted
    5.8Free plan
  5. 8SAS Advanced Analytics logo

    SAS Advanced Analytics

    SAS Advanced Analytics refers to SAS Viya, a cloud-native data and AI platform for connecting data, building and governing models, and operationalizing decisions.

    APISelf-hosted
    5.8
  6. 9Vertex AI Vector Search logo

    Vertex AI Vector Search

    Vertex AI Vector Search is a vector search engine for search, recommendations, and generative AI applications.

    WebAPI
    5.8
  7. 10

    auditor

    LinuxmacOSWindows
    5.2
  8. 11

    ExplainerDashboard

    WebLinuxmacOSWindows
    5.0
  9. 12

    DiCE

    LinuxmacOSWindows
    4.7
  10. 13

    ELI5

    LinuxmacOSWindows
    4.7
  11. 14

    Fairness Indicators

    LinuxmacOSWindows
    4.7
  12. 15

    fastshap

    LinuxmacOSWindows
    4.7
  13. 16

    InterpretML

    LinuxmacOSWindows
    4.7
  14. 17

    OmniXAI

    LinuxmacOSWindows
    4.7
  15. 18

    PDPbox

    LinuxmacOSWindows
    4.7
  16. 19

    Responsible AI Toolbox

    LinuxmacOSWindows
    4.7
  17. 20

    treeshap

    LinuxmacOSWindows
    4.7
  18. 21
    4.6
  19. 22
    4.6
  20. 23
    4.6
  21. 24

    Zeno

    Web
    4.6
  22. 25
    4.3

Choosing well

Check where it runs

Look for the platform that matches your workflow. Options in this category include Linux, macOS, Windows, web, API and self-hosted deployments.

If you plan to work from an Android phone or tablet, verify that the product provides an Android app or a usable web interface.

Match the explanation method

Feature attribution shows which inputs influenced a prediction. Counterfactual explanations describe changes that could produce a different result.

Fairness analysis and audit reports help review model behavior and document findings. Compare the methods that fit your review process.

Review free and paid access

A free plan can let you assess a tool before paying. A free trial may provide temporary access to paid features.

Check the listed paid starting price and whether pricing is available on request.

Confirm deployment and model support

Deployment options range from hosted web services and APIs to self-hosted software. Choose the setup that fits your data handling needs.

Check supported model types before importing a project, since compatibility can differ between tools.

Questions people ask

Can I start with a free plan?

Yes. A free plan is offered by items in this category. Check the individual listing for its access terms and limits.

What is feature attribution?

Feature attribution identifies inputs that influenced a model prediction. It is one comparison field used for this category.

What are counterfactual explanations?

Counterfactual explanations show changes to inputs that could lead to a different prediction.

Do these tools support fairness reviews?

Fairness analysis is a comparison field for this category. Check a product's details to confirm its specific support.

More in AI Tools

The whole section