An efficient Quasi-Newton method for nonlinear inverse problems via learned singular values

12/14/2020
by   Danny Smyl, et al.
12

Solving complex optimization problems in engineering and the physical sciences requires repetitive computation of multi-dimensional function derivatives. Commonly, this requires computationally-demanding numerical differentiation such as perturbation techniques, which ultimately limits the use for time-sensitive applications. In particular, in nonlinear inverse problems Gauss-Newton methods are used that require iterative updates to be computed from the Jacobian. Computationally more efficient alternatives are Quasi-Newton methods, where the repeated computation of the Jacobian is replaced by an approximate update. Here we present a highly efficient data-driven Quasi-Newton method applicable to nonlinear inverse problems. We achieve this, by using the singular value decomposition and learning a mapping from model outputs to the singular values to compute the updated Jacobian. This enables a speed-up expected of Quasi-Newton methods without accumulating roundoff errors, enabling time-critical applications and allowing for flexible incorporation of prior knowledge necessary to solve ill-posed problems. We present results for the highly non-linear inverse problem of electrical impedance tomography with experimental data.

READ FULL TEXT

page 1

page 4

research
02/19/2020

Relaxed Gauss-Newton methods with applications to electrical impedance tomography

As second-order methods, Gauss–Newton-type methods can be more effective...
research
06/13/2019

Inverse Problems, Regularization and Applications

Inverse problems arise in a wide spectrum of applications in fields rang...
research
05/28/2017

LAP: a Linearize and Project Method for Solving Inverse Problems with Coupled Variables

Many inverse problems involve two or more sets of variables that represe...
research
05/29/2020

Learning and correcting non-Gaussian model errors

All discretized numerical models contain modelling errors - this reality...
research
07/06/2021

SGN: Sparse Gauss-Newton for Accelerated Sensitivity Analysis

We present a sparse Gauss-Newton solver for accelerated sensitivity anal...
research
03/28/2021

Graph Convolutional Networks for Model-Based Learning in Nonlinear Inverse Problems

The majority of model-based learned image reconstruction methods in medi...
research
07/27/2022

On a Dynamic Variant of the Iteratively Regularized Gauss-Newton Method with Sequential Data

For numerous parameter and state estimation problems, assimilating new d...

Please sign up or login with your details

Forgot password? Click here to reset