On Unifying Randomized Methods For Inverse Problems

01/03/2023
by   Jonathan Wittmer, et al.
0

This work unifies the analysis of various randomized methods for solving linear and nonlinear inverse problems by framing the problem in a stochastic optimization setting. By doing so, we show that many randomized methods are variants of a sample average approximation. More importantly, we are able to prove a single theoretical result that guarantees the asymptotic convergence for a variety of randomized methods. Additionally, viewing randomized methods as a sample average approximation enables us to prove, for the first time, a single non-asymptotic error result that holds for randomized methods under consideration. Another important consequence of our unified framework is that it allows us to discover new randomization methods. We present various numerical results for linear, nonlinear, algebraic, and PDE-constrained inverse problems that verify the theoretical convergence results and provide a discussion on the apparently different convergence rates and the behavior for various randomized methods.

READ FULL TEXT
research
01/15/2017

Probabilistic Numerical Methods for PDE-constrained Bayesian Inverse Problems

This paper develops meshless methods for probabilistically describing di...
research
06/10/2019

Randomization and reweighted ℓ_1-minimization for A-optimal design of linear inverse problems

We consider optimal design of PDE-based Bayesian linear inverse problems...
research
07/06/2020

Consistency analysis of bilevel data-driven learning in inverse problems

One fundamental problem when solving inverse problems is how to find reg...
research
12/11/2020

Non-asymptotic error estimates for the Laplace approximation in Bayesian inverse problems

In this paper we study properties of the Laplace approximation of the po...
research
06/22/2021

Faster Randomized Methods for Orthogonality Constrained Problems

Recent literature has advocated the use of randomized methods for accele...
research
01/24/2023

Sequential model correction for nonlinear inverse problems

Inverse problems are in many cases solved with optimization techniques. ...
research
07/06/2021

SGN: Sparse Gauss-Newton for Accelerated Sensitivity Analysis

We present a sparse Gauss-Newton solver for accelerated sensitivity anal...

Please sign up or login with your details

Forgot password? Click here to reset