Unscented Kalman Inversion

02/02/2021
by   Daniel Z. Huang, et al.
0

A useful approach to solve inverse problems is to pair the parameter-to-data map with a stochastic dynamical system for the parameter, and then employ techniques from filtering to estimate the parameter given the data. Three classical approaches to filtering of nonlinear systems are the extended, ensemble and unscented Kalman filters. The extended Kalman inversion (ExKI) is impractical when the forward map is not readily differentiable and given as a black box, and also for high dimensional parameter spaces because of the need to propagate large covariance matrices. Ensemble Kalman inversion (EKI) has emerged as a useful tool which overcomes both of these issues: it is derivative free and works with a low-rank covariance approximation formed from the ensemble. In this paper, we demonstrate that unscented Kalman methods also provide an effective tool for derivative-free inversion in the setting of black-box forward models, introducing unscented Kalman inversion (UKI). Theoretical analysis is provided for linear inverse problems, and a smoothing property of the data mis-fit under the unscented transform is explained. We provide numerical experiments, including various applications: learning subsurface flow permeability parameters; learning the structure damage field; learning the Navier-Stokes initial condition; and learning subgrid-scale parameters in a general circulation model. The theory and experiments show that the UKI outperforms the EKI on parameter learning problems with moderate numbers of parameters and outperforms the ExKI on problems where the forward model is not readily differentiable, or where the derivative is very sensitive. In particular, UKI based methods are of particular value for parameter estimation problems in which the number of parameters is moderate but the forward model is expensive and provided as a black box which is impractical to differentiate.

READ FULL TEXT

page 21

page 23

page 24

page 25

page 26

page 27

page 29

page 35

research
02/21/2021

Improve Unscented Kalman Inversion With Low-Rank Approximation and Reduced-Order Model

The unscented Kalman inversion (UKI) presented in [1] is a general deriv...
research
07/26/2022

A Review of the EnKF for Parameter Estimation

The ensemble Kalman filter is a well-known and celebrated data assimilat...
research
03/29/2023

EnKSGD: A Class Of Preconditioned Black Box Optimization And Inversion Algorithms

In this paper, we introduce the Ensemble Kalman-Stein Gradient Descent (...
research
04/07/2021

Ensemble Inference Methods for Models With Noisy and Expensive Likelihoods

The increasing availability of data presents an opportunity to calibrate...
research
05/20/2021

Bayesian Calibration for Large-Scale Fluid Structure Interaction Problems Under Embedded/Immersed Boundary Framework

Bayesian calibration is widely used for inverse analysis and uncertainty...
research
03/31/2022

Gradient flow structure and convergence analysis of the ensemble Kalman inversion for nonlinear forward models

The ensemble Kalman inversion (EKI) is a particle based method which has...
research
01/10/2020

Calibrate, Emulate, Sample

Many parameter estimation problems arising in applications are best cast...

Please sign up or login with your details

Forgot password? Click here to reset