Uncertainty Quantification 360: A Holistic Toolkit for Quantifying and Communicating the Uncertainty of AI

06/02/2021
by   Soumya Ghosh, et al.
107

In this paper, we describe an open source Python toolkit named Uncertainty Quantification 360 (UQ360) for the uncertainty quantification of AI models. The goal of this toolkit is twofold: first, to provide a broad range of capabilities to streamline as well as foster the common practices of quantifying, evaluating, improving, and communicating uncertainty in the AI application development lifecycle; second, to encourage further exploration of UQ's connections to other pillars of trustworthy AI such as fairness and transparency through the dissemination of latest research and education materials. Beyond the Python package (<https://github.com/IBM/UQ360>), we have developed an interactive experience (<http://uq360.mybluemix.net>) and guidance materials as educational tools to aid researchers and developers in producing and communicating high-quality uncertainties in an effective manner.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/03/2018

AI Fairness 360: An Extensible Toolkit for Detecting, Understanding, and Mitigating Unwanted Algorithmic Bias

Fairness is an increasingly important concern as machine learning models...
research
08/05/2022

Interpretable Uncertainty Quantification in AI for HEP

Estimating uncertainty is at the core of performing scientific measureme...
research
10/08/2020

VECMAtk: A Scalable Verification, Validation and Uncertainty Quantification Toolkit for Scientific Simulations

We present the VECMA toolkit (VECMAtk), a flexible software environment ...
research
02/14/2022

Quantus: An Explainable AI Toolkit for Responsible Evaluation of Neural Network Explanations

The evaluation of explanation methods is a research topic that has not y...
research
12/05/2017

The Role of Data Analysis in Uncertainty Quantification: Case Studies for Materials Modeling

In computational materials science, mechanical properties are typically ...
research
06/24/2022

How is model-related uncertainty quantified and reported in different disciplines?

How do we know how much we know? Quantifying uncertainty associated with...
research
03/28/2022

Accelerating innovation with software abstractions for scalable computational geophysics

We present the SLIM (https://github.com/slimgroup) open-source software ...

Please sign up or login with your details

Forgot password? Click here to reset