DeepAI AI Chat
Log In Sign Up

Subsampling in ensemble Kalman inversion

by   Matei Hanu, et al.

We consider the Ensemble Kalman Inversion which has been recently introduced as an efficient, gradient-free optimisation method to estimate unknown parameters in an inverse setting. In the case of large data sets, the Ensemble Kalman Inversion becomes computationally infeasible as the data misfit needs to be evaluated for each particle in each iteration. Here, randomised algorithms like stochastic gradient descent have been demonstrated to successfully overcome this issue by using only a random subset of the data in each iteration, so-called subsampling techniques. Based on a recent analysis of a continuous-time representation of stochastic gradient methods, we propose, analyse, and apply subsampling-techniques within Ensemble Kalman Inversion. Indeed, we propose two different subsampling techniques: either every particle observes the same data subset (single subsampling) or every particle observes a different data subset (batch subsampling).


Ensemble Kalman Inversion for General Likelihoods

Ensemble Kalman inversion represents a powerful technique for inference ...

Ensemble Kalman Inversion: A Derivative-Free Technique For Machine Learning Tasks

The standard probabilistic perspective on machine learning gives rise to...

Continuous time limit of the stochastic ensemble Kalman inversion: Strong convergence analysis

The Ensemble Kalman inversion (EKI) method is a method for the estimatio...

Gradient flow structure and convergence analysis of the ensemble Kalman inversion for nonlinear forward models

The ensemble Kalman inversion (EKI) is a particle based method which has...

On convergence rates of adaptive ensemble Kalman inversion for linear ill-posed problems

In this paper we show that ensemble Kalman inversion for linear inverse ...

Adaptive regularisation for ensemble Kalman inversion with applications to non-destructive testing and imaging

We propose a new regularisation strategy within the classical ensemble K...

Localization in Ensemble Kalman inversion

Ensemble Kalman inversion (EKI) is a technique for the numerical solutio...