Uncertainty Quantification 360: A Holistic Toolkit for Quantifying and Communicating the Uncertainty of AI

by   Soumya Ghosh, et al.

In this paper, we describe an open source Python toolkit named Uncertainty Quantification 360 (UQ360) for the uncertainty quantification of AI models. The goal of this toolkit is twofold: first, to provide a broad range of capabilities to streamline as well as foster the common practices of quantifying, evaluating, improving, and communicating uncertainty in the AI application development lifecycle; second, to encourage further exploration of UQ's connections to other pillars of trustworthy AI such as fairness and transparency through the dissemination of latest research and education materials. Beyond the Python package (<https://github.com/IBM/UQ360>), we have developed an interactive experience (<http://uq360.mybluemix.net>) and guidance materials as educational tools to aid researchers and developers in producing and communicating high-quality uncertainties in an effective manner.


page 1

page 2

page 3

page 4


Interpretable Uncertainty Quantification in AI for HEP

Estimating uncertainty is at the core of performing scientific measureme...

VECMAtk: A Scalable Verification, Validation and Uncertainty Quantification Toolkit for Scientific Simulations

We present the VECMA toolkit (VECMAtk), a flexible software environment ...

Quantus: An Explainable AI Toolkit for Responsible Evaluation of Neural Network Explanations

The evaluation of explanation methods is a research topic that has not y...

The Role of Data Analysis in Uncertainty Quantification: Case Studies for Materials Modeling

In computational materials science, mechanical properties are typically ...

How is model-related uncertainty quantified and reported in different disciplines?

How do we know how much we know? Quantifying uncertainty associated with...

Accelerating innovation with software abstractions for scalable computational geophysics

We present the SLIM (https://github.com/slimgroup) open-source software ...

Code Repositories


Uncertainty Quantification 360 (UQ360) is an extensible open-source toolkit that can help you estimate, communicate and use uncertainty in machine learning model predictions.

view repo

Please sign up or login with your details

Forgot password? Click here to reset