Distributional Gaussian Process Layers for Outlier Detection in Image Segmentation

04/28/2021
by   Sebastian G. Popescu, et al.
25

We propose a parameter efficient Bayesian layer for hierarchical convolutional Gaussian Processes that incorporates Gaussian Processes operating in Wasserstein-2 space to reliably propagate uncertainty. This directly replaces convolving Gaussian Processes with a distance-preserving affine operator on distributions. Our experiments on brain tissue-segmentation show that the resulting architecture approaches the performance of well-established deterministic segmentation algorithms (U-Net), which has never been achieved with previous hierarchical Gaussian Processes. Moreover, by applying the same segmentation model to out-of-distribution data (i.e., images with pathology such as brain tumors), we show that our uncertainty estimates result in out-of-distribution detection that outperforms the capabilities of previous Bayesian networks and reconstruction-based approaches that learn normative distributions.

READ FULL TEXT

page 3

page 6

page 8

research
06/27/2022

Distributional Gaussian Processes Layers for Out-of-Distribution Detection

Machine learning models deployed on medical imaging tasks must be equipp...
research
10/28/2020

Hierarchical Gaussian Processes with Wasserstein-2 Kernels

We investigate the usefulness of Wasserstein-2 kernels in the context of...
research
11/30/2017

How Deep Are Deep Gaussian Processes?

Recent research has shown the potential utility of probability distribut...
research
06/08/2022

Neural Diffusion Processes

Gaussian processes provide an elegant framework for specifying prior and...
research
05/29/2023

Gaussian Process Probes (GPP) for Uncertainty-Aware Probing

Understanding which concepts models can and cannot represent has been fu...
research
05/02/2018

Gaussian Process Forecast with multidimensional distributional entries

In this work, we propose to define Gaussian Processes indexed by multidi...
research
03/04/2023

Calibrating Transformers via Sparse Gaussian Processes

Transformer models have achieved profound success in prediction tasks in...

Please sign up or login with your details

Forgot password? Click here to reset