Subsampling in ensemble Kalman inversion

02/22/2023
by   Matei Hanu, et al.
0

We consider the Ensemble Kalman Inversion which has been recently introduced as an efficient, gradient-free optimisation method to estimate unknown parameters in an inverse setting. In the case of large data sets, the Ensemble Kalman Inversion becomes computationally infeasible as the data misfit needs to be evaluated for each particle in each iteration. Here, randomised algorithms like stochastic gradient descent have been demonstrated to successfully overcome this issue by using only a random subset of the data in each iteration, so-called subsampling techniques. Based on a recent analysis of a continuous-time representation of stochastic gradient methods, we propose, analyse, and apply subsampling-techniques within Ensemble Kalman Inversion. Indeed, we propose two different subsampling techniques: either every particle observes the same data subset (single subsampling) or every particle observes a different data subset (batch subsampling).

READ FULL TEXT
research
10/06/2021

Ensemble Kalman Inversion for General Likelihoods

Ensemble Kalman inversion represents a powerful technique for inference ...
research
08/10/2018

Ensemble Kalman Inversion: A Derivative-Free Technique For Machine Learning Tasks

The standard probabilistic perspective on machine learning gives rise to...
research
07/30/2021

Continuous time limit of the stochastic ensemble Kalman inversion: Strong convergence analysis

The Ensemble Kalman inversion (EKI) method is a method for the estimatio...
research
03/31/2022

Gradient flow structure and convergence analysis of the ensemble Kalman inversion for nonlinear forward models

The ensemble Kalman inversion (EKI) is a particle based method which has...
research
04/22/2021

On convergence rates of adaptive ensemble Kalman inversion for linear ill-posed problems

In this paper we show that ensemble Kalman inversion for linear inverse ...
research
03/22/2022

Gradient flows and randomised thresholding: sparse inversion and classification

Sparse inversion and classification problems are ubiquitous in modern da...
research
06/26/2020

Adaptive regularisation for ensemble Kalman inversion with applications to non-destructive testing and imaging

We propose a new regularisation strategy within the classical ensemble K...

Please sign up or login with your details

Forgot password? Click here to reset