Scalable Uncertainty for Computer Vision with Functional Variational Inference

03/06/2020
by   Eduardo D C Carvalho, et al.
11

As Deep Learning continues to yield successful applications in Computer Vision, the ability to quantify all forms of uncertainty is a paramount requirement for its safe and reliable deployment in the real-world. In this work, we leverage the formulation of variational inference in function space, where we associate Gaussian Processes (GPs) to both Bayesian CNN priors and variational family. Since GPs are fully determined by their mean and covariance functions, we are able to obtain predictive uncertainty estimates at the cost of a single forward pass through any chosen CNN architecture and for any supervised learning task. By leveraging the structure of the induced covariance matrices, we propose numerically efficient algorithms which enable fast training in the context of high-dimensional tasks such as depth estimation and semantic segmentation. Additionally, we provide sufficient conditions for constructing regression loss functions whose probabilistic counterparts are compatible with aleatoric uncertainty quantification.

READ FULL TEXT

page 7

page 8

page 13

page 14

page 15

research
05/24/2017

Doubly Stochastic Variational Inference for Deep Gaussian Processes

Gaussian processes (GPs) are a good choice for function approximation as...
research
06/14/2022

Deep Variational Implicit Processes

Implicit processes (IPs) are a generalization of Gaussian processes (GPs...
research
05/12/2022

Generalized Variational Inference in Function Spaces: Gaussian Measures meet Bayesian Deep Learning

We develop a framework for generalized variational inference in infinite...
research
07/31/2020

Learning the Distribution: A Unified Distillation Paradigm for Fast Uncertainty Estimation in Computer Vision

Calibrated estimates of uncertainty are critical for many real-world com...
research
03/14/2019

Functional Variational Bayesian Neural Networks

Variational Bayesian neural networks (BNNs) perform variational inferenc...
research
02/25/2020

Variational Inference and Bayesian CNNs for Uncertainty Estimation in Multi-Factorial Bone Age Prediction

Additionally to the extensive use in clinical medicine, biological age (...
research
04/04/2019

Robust Deep Gaussian Processes

This report provides an in-depth overview over the implications and nove...

Please sign up or login with your details

Forgot password? Click here to reset