Posterior temperature optimized Bayesian models for inverse problems in medical imaging

02/02/2022
by   Max-Heinrich Laves, et al.
0

We present Posterior Temperature Optimized Bayesian Inverse Models (POTOBIM), an unsupervised Bayesian approach to inverse problems in medical imaging using mean-field variational inference with a fully tempered posterior. Bayesian methods exhibit useful properties for approaching inverse tasks, such as tomographic reconstruction or image denoising. A suitable prior distribution introduces regularization, which is needed to solve the ill-posed problem and reduces overfitting the data. In practice, however, this often results in a suboptimal posterior temperature, and the full potential of the Bayesian approach is not being exploited. In POTOBIM, we optimize both the parameters of the prior distribution and the posterior temperature with respect to reconstruction accuracy using Bayesian optimization with Gaussian process regression. Our method is extensively evaluated on four different inverse tasks on a variety of modalities with images from public data sets and we demonstrate that an optimized posterior temperature outperforms both non-Bayesian and Bayesian approaches without temperature optimization. The use of an optimized prior distribution and posterior temperature leads to improved accuracy and uncertainty estimation and we show that it is sufficient to find these hyperparameters per task domain. Well-tempered posteriors yield calibrated uncertainty, which increases the reliability in the predictions. Our source code is publicly available at github.com/Cardio-AI/mfvi-dip-mia.

READ FULL TEXT

page 9

page 10

page 11

page 16

page 19

page 20

page 23

page 25

research
06/11/2021

Posterior Temperature Optimization in Variational Inference

Cold posteriors have been reported to perform better in practice in the ...
research
04/15/2023

A tutorial on the Bayesian statistical approach to inverse problems

Inverse problems are ubiquitous in the sciences and engineering. Two cat...
research
08/20/2020

Uncertainty Estimation in Medical Image Denoising with Bayesian Deep Image Prior

Uncertainty quantification in inverse medical imaging tasks with deep le...
research
07/31/2020

Cold Posteriors and Aleatoric Uncertainty

Recent work has observed that one can outperform exact inference in Baye...
research
09/11/2023

The fine print on tempered posteriors

We conduct a detailed investigation of tempered posteriors and uncover a...
research
01/14/2022

Probabilistic Mass Mapping with Neural Score Estimation

Weak lensing mass-mapping is a useful tool to access the full distributi...
research
11/05/2021

Edge Tracing using Gaussian Process Regression

We introduce a novel edge tracing algorithm using Gaussian process regre...

Please sign up or login with your details

Forgot password? Click here to reset