SGN: Sparse Gauss-Newton for Accelerated Sensitivity Analysis

07/06/2021
by   Jonas Zehnder, et al.
0

We present a sparse Gauss-Newton solver for accelerated sensitivity analysis with applications to a wide range of equilibrium-constrained optimization problems. Dense Gauss-Newton solvers have shown promising convergence rates for inverse problems, but the cost of assembling and factorizing the associated matrices has so far been a major stumbling block. In this work, we show how the dense Gauss-Newton Hessian can be transformed into an equivalent sparse matrix that can be assembled and factorized much more efficiently. This leads to drastically reduced computation times for many inverse problems, which we demonstrate on a diverse set of examples. We furthermore show links between sensitivity analysis and nonlinear programming approaches based on Lagrange multipliers and prove equivalence under specific assumptions that apply for our problem setting.

READ FULL TEXT
research
11/13/2019

Benchmarking results for the Newton-Anderson method

This paper primarily presents numerical results for the Anderson acceler...
research
02/19/2020

Relaxed Gauss-Newton methods with applications to electrical impedance tomography

As second-order methods, Gauss–Newton-type methods can be more effective...
research
01/09/2023

Hierarchical off-diagonal low-rank approximation of Hessians in inverse problems, with application to ice sheet model initializaiton

Obtaining lightweight and accurate approximations of Hessian applies in ...
research
12/14/2020

An efficient Quasi-Newton method for nonlinear inverse problems via learned singular values

Solving complex optimization problems in engineering and the physical sc...
research
01/25/2022

A semismooth Newton-proximal method of multipliers for ℓ_1-regularized convex quadratic programming

In this paper we present a method for the solution of ℓ_1-regularized co...
research
11/30/2021

Bayesian Level Set Approach for Inverse Problems with Piecewise Constant Reconstructions

There are several challenges associated with inverse problems in which w...
research
01/03/2023

On Unifying Randomized Methods For Inverse Problems

This work unifies the analysis of various randomized methods for solving...

Please sign up or login with your details

Forgot password? Click here to reset