Multilevel Optimization for Inverse Problems

04/28/2022
by   Simon Weissmann, et al.
0

Inverse problems occur in a variety of parameter identification tasks in engineering. Such problems are challenging in practice, as they require repeated evaluation of computationally expensive forward models. We introduce a unifying framework of multilevel optimization that can be applied to a wide range of optimization-based solvers. Our framework provably reduces the computational cost associated with evaluating the expensive forward maps stemming from various physical models. To demonstrate the versatility of our analysis, we discuss its implications for various methodologies including multilevel (accelerated, stochastic) gradient descent, a multilevel ensemble Kalman inversion and a multilevel Langevin sampler. We also provide numerical experiments to verify our theoretical findings.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/05/2021

Multilevel Stein variational gradient descent with applications to Bayesian inverse problems

This work presents a multilevel variant of Stein variational gradient de...
research
12/06/2022

Further analysis of multilevel Stein variational gradient descent with an application to the Bayesian inference of glacier ice models

Multilevel Stein variational gradient descent is a method for particle-b...
research
04/27/2019

Multilevel adaptive sparse Leja approximations for Bayesian inverse problems

Deterministic interpolation and quadrature methods are often unsuitable ...
research
05/28/2021

A Gradient Method for Multilevel Optimization

Although application examples of multilevel optimization have already be...
research
03/18/2020

Data-Driven Forward Discretizations for Bayesian Inversion

This paper suggests a framework for the learning of discretizations of e...
research
02/21/2020

Differentiable Likelihoods for Fast Inversion of 'Likelihood-Free' Dynamical Systems

Likelihood-free (a.k.a. simulation-based) inference problems are inverse...
research
07/01/2020

A Posteriori Error Estimates for Multilevel Methods for Graph Laplacians

In this paper, we study a posteriori error estimators which aid multilev...

Please sign up or login with your details

Forgot password? Click here to reset