Data-Free Likelihood-Informed Dimension Reduction of Bayesian Inverse Problems

by   Tiangang Cui, et al.

Identifying a low-dimensional informed parameter subspace offers a viable path to alleviating the dimensionality challenge in the sampled-based solution to large-scale Bayesian inverse problems. This paper introduces a novel gradient-based dimension reduction method in which the informed subspace does not depend on the data. This permits an online-offline computational strategy where the expensive low-dimensional structure of the problem is detected in an offline phase, meaning before observing the data. This strategy is particularly relevant for multiple inversion problems as the same informed subspace can be reused. The proposed approach allows controlling the approximation error (in expectation over the data) of the posterior distribution. We also present sampling strategies that exploit the informed subspace to draw efficiently samples from the exact posterior distribution. The method is successfully illustrated on two numerical examples: a PDE-based inverse problem with a Gaussian process prior and a tomography problem with Poisson data and a Besov-ℬ^2_11 prior.


Certified Dimension Reduction for Bayesian Updating with the Cross-Entropy Method

In inverse problems, the parameters of a model are estimated based on ob...

Stein variational reduced basis Bayesian inversion

We propose and analyze a Stein variational reduced basis method (SVRB) t...

A unified performance analysis of likelihood-informed subspace methods

The likelihood-informed subspace (LIS) method offers a viable route to r...

Scalable optimization-based sampling on function space

Optimization-based samplers provide an efficient and parallellizable app...

Gradient-based data and parameter dimension reduction for Bayesian models: an information theoretic perspective

We consider the problem of reducing the dimensions of parameters and dat...

Bayesian inverse regression for supervised dimension reduction with small datasets

We consider supervised dimension reduction problems, namely to identify ...

Please sign up or login with your details

Forgot password? Click here to reset