DeepAI AI Chat
Log In Sign Up

An efficient Quasi-Newton method for nonlinear inverse problems via learned singular values

by   Danny Smyl, et al.

Solving complex optimization problems in engineering and the physical sciences requires repetitive computation of multi-dimensional function derivatives. Commonly, this requires computationally-demanding numerical differentiation such as perturbation techniques, which ultimately limits the use for time-sensitive applications. In particular, in nonlinear inverse problems Gauss-Newton methods are used that require iterative updates to be computed from the Jacobian. Computationally more efficient alternatives are Quasi-Newton methods, where the repeated computation of the Jacobian is replaced by an approximate update. Here we present a highly efficient data-driven Quasi-Newton method applicable to nonlinear inverse problems. We achieve this, by using the singular value decomposition and learning a mapping from model outputs to the singular values to compute the updated Jacobian. This enables a speed-up expected of Quasi-Newton methods without accumulating roundoff errors, enabling time-critical applications and allowing for flexible incorporation of prior knowledge necessary to solve ill-posed problems. We present results for the highly non-linear inverse problem of electrical impedance tomography with experimental data.


page 1

page 4


Relaxed Gauss-Newton methods with applications to electrical impedance tomography

As second-order methods, Gauss–Newton-type methods can be more effective...

Inverse Problems, Regularization and Applications

Inverse problems arise in a wide spectrum of applications in fields rang...

LAP: a Linearize and Project Method for Solving Inverse Problems with Coupled Variables

Many inverse problems involve two or more sets of variables that represe...

Learning and correcting non-Gaussian model errors

All discretized numerical models contain modelling errors - this reality...

SGN: Sparse Gauss-Newton for Accelerated Sensitivity Analysis

We present a sparse Gauss-Newton solver for accelerated sensitivity anal...

Graph Convolutional Networks for Model-Based Learning in Nonlinear Inverse Problems

The majority of model-based learned image reconstruction methods in medi...

On a Dynamic Variant of the Iteratively Regularized Gauss-Newton Method with Sequential Data

For numerous parameter and state estimation problems, assimilating new d...