Scalable Uncertainty Quantification for Deep Operator Networks using Randomized Priors

03/06/2022
by   Yibo Yang, et al.
0

We present a simple and effective approach for posterior uncertainty quantification in deep operator networks (DeepONets); an emerging paradigm for supervised learning in function spaces. We adopt a frequentist approach based on randomized prior ensembles, and put forth an efficient vectorized implementation for fast parallel inference on accelerated hardware. Through a collection of representative examples in computational mechanics and climate modeling, we show that the merits of the proposed approach are fourfold. (1) It can provide more robust and accurate predictions when compared against deterministic DeepONets. (2) It shows great capability in providing reliable uncertainty estimates on scarce data-sets with multi-scale function pairs. (3) It can effectively detect out-of-distribution and adversarial examples. (4) It can seamlessly quantify uncertainty due to model bias, as well as noise corruption in the data. Finally, we provide an optimized JAX library called UQDeepONet that can accommodate large model architectures, large ensemble sizes, as well as large data-sets with excellent parallel performance on accelerated hardware, thereby enabling uncertainty quantification for DeepONets in realistic large-scale applications.

READ FULL TEXT

page 14

page 22

page 23

research
02/08/2023

Fortuna: A Library for Uncertainty Quantification in Deep Learning

We present Fortuna, an open-source library for uncertainty quantificatio...
research
05/10/2019

Large scale in transit computation of quantiles for ensemble runs

The classical approach for quantiles computation requires availability o...
research
02/02/2023

Randomized prior wavelet neural operator for uncertainty quantification

In this paper, we propose a novel data-driven operator learning framewor...
research
07/09/2020

Uncertainty Quantification in Deep Residual Neural Networks

Uncertainty quantification is an important and challenging problem in de...
research
05/12/2021

SPUX Framework: a Scalable Package for Bayesian Uncertainty Quantification and Propagation

We present SPUX - a modular framework for Bayesian inference enabling un...
research
03/04/2020

Simple and Scalable Epistemic Uncertainty Estimation Using a Single Deep Deterministic Neural Network

We propose a method for training a deterministic deep model that can fin...
research
05/30/2023

Probabilistic Computation with Emerging Covariance: Towards Efficient Uncertainty Quantification

Building robust, interpretable, and secure artificial intelligence syste...

Please sign up or login with your details

Forgot password? Click here to reset