Uncertainty Propagation in Deep Neural Network Using Active Subspace

03/10/2019
by   Weiqi Ji, et al.
0

The inputs of deep neural network (DNN) from real-world data usually come with uncertainties. Yet, it is challenging to propagate the uncertainty in the input features to the DNN predictions at a low computational cost. This work employs a gradient-based subspace method and response surface technique to accelerate the uncertainty propagation in DNN. Specifically, the active subspace method is employed to identify the most important subspace in the input features using the gradient of the DNN output to the inputs. Then the response surface within that low-dimensional subspace can be efficiently built, and the uncertainty of the prediction can be acquired by evaluating the computationally cheap response surface instead of the DNN models. In addition, the subspace can help explain the adversarial examples. The approach is demonstrated in MNIST datasets with a convolutional neural network.

READ FULL TEXT
research
06/30/2021

Understanding Adversarial Examples Through Deep Neural Network's Response Surface and Uncertainty Regions

Deep neural network (DNN) is a popular model implemented in many systems...
research
09/17/2018

Uncertainty Propagation in Deep Neural Networks Using Extended Kalman Filtering

Extended Kalman Filtering (EKF) can be used to propagate and quantify in...
research
04/24/2018

Deep Neural Network Based Subspace Learning of Robotic Manipulator Workspace Mapping

The manipulator workspace mapping is an important problem in robotics an...
research
10/29/2019

Active Subspace of Neural Networks: Structural Analysis and Universal Attacks

Active subspace is a model reduction method widely used in the uncertain...
research
05/23/2023

Leveraging Uncertainty Quantification for Picking Robust First Break Times

In seismic exploration, the selection of first break times is a crucial ...
research
08/08/2020

A Fully Bayesian Gradient-Free Supervised Dimension Reduction Method using Gaussian Processes

Modern day engineering problems are ubiquitously characterized by sophis...
research
04/04/2023

HarsanyiNet: Computing Accurate Shapley Values in a Single Forward Propagation

The Shapley value is widely regarded as a trustworthy attribution metric...

Please sign up or login with your details

Forgot password? Click here to reset