Uncertainty Quantification 360: A Holistic Toolkit for Quantifying and Communicating the Uncertainty of AI

by   Soumya Ghosh, et al.

In this paper, we describe an open source Python toolkit named Uncertainty Quantification 360 (UQ360) for the uncertainty quantification of AI models. The goal of this toolkit is twofold: first, to provide a broad range of capabilities to streamline as well as foster the common practices of quantifying, evaluating, improving, and communicating uncertainty in the AI application development lifecycle; second, to encourage further exploration of UQ's connections to other pillars of trustworthy AI such as fairness and transparency through the dissemination of latest research and education materials. Beyond the Python package (<https://github.com/IBM/UQ360>), we have developed an interactive experience (<http://uq360.mybluemix.net>) and guidance materials as educational tools to aid researchers and developers in producing and communicating high-quality uncertainties in an effective manner.


page 1

page 2

page 3

page 4


AI Fairness 360: An Extensible Toolkit for Detecting, Understanding, and Mitigating Unwanted Algorithmic Bias

Fairness is an increasingly important concern as machine learning models...

Interpretable Uncertainty Quantification in AI for HEP

Estimating uncertainty is at the core of performing scientific measureme...

VECMAtk: A Scalable Verification, Validation and Uncertainty Quantification Toolkit for Scientific Simulations

We present the VECMA toolkit (VECMAtk), a flexible software environment ...

How is model-related uncertainty quantified and reported in different disciplines?

How do we know how much we know? Quantifying uncertainty associated with...

The Role of Data Analysis in Uncertainty Quantification: Case Studies for Materials Modeling

In computational materials science, mechanical properties are typically ...

Accelerating innovation with software abstractions for scalable computational geophysics

We present the SLIM (https://github.com/slimgroup) open-source software ...

Code Repositories


Uncertainty Quantification 360 (UQ360) is an extensible open-source toolkit that can help you estimate, communicate and use uncertainty in machine learning model predictions.

view repo