Regularization of the ensemble Kalman filter using a non-stationary spatial convolution model

06/25/2023
by   Michael Tsyrulnikov, et al.
0

Applications of the ensemble Kalman filter to high-dimensional problems are feasible only with small ensembles. This necessitates a kind of regularization of the analysis (observation update) problem. We propose a regularization technique based on a new non-stationary, non-parametric spatial model on the sphere. The model termed the Locally Stationary Convolution Model is a constrained version of the general Gaussian process convolution model. The constraints on the location-dependent convolution kernel include local isotropy, positive definiteness as a function of distance, and smoothness as a function of location. The model allows for a rigorous definition of the local spectrum, which is required to be a smooth function of spatial wavenumber. We propose and test an ensemble filter in which prior covariances are postulated to obey the Locally Stationary Convolution Model. The model is estimated online in a two-stage procedure. First, ensemble perturbations are bandpass filtered in several wavenumber bands to extract aggregated local spatial spectra. Second, a neural network recovers the local spectra from sample variances of the filtered fields. In simulation experiments, the new filter was capable of outperforming several existing techniques. With small to moderate ensemble sizes, the improvement was substantial.

READ FULL TEXT
research
11/06/2018

Kalman Filter Modifier for Neural Networks in Non-stationary Environments

Learning in a non-stationary environment is an inevitable problem when a...
research
07/30/2018

Kalman Filter-based Heuristic Ensemble: A New Perspective on Ensemble Classification Using Kalman Filters

A classifier ensemble is a combination of multiple diverse classifier mo...
research
08/04/2021

Investigating the Pilot Point Ensemble Kalman Filter for geostatistical inversion and data assimilation

Parameter estimation has a high importance in the geosciences. The ensem...
research
07/01/2020

A Multifidelity Ensemble Kalman Filter with Reduced Order Control Variates

This work develops a new multifidelity ensemble Kalman filter (MFEnKF) a...
research
08/23/2018

Comparing seven variants of the Ensemble Kalman Filter: How many synthetic experiments are needed?

The Ensemble Kalman Filter (EnKF) is a popular estimation technique in t...
research
06/14/2023

Kalman Filter for Online Classification of Non-Stationary Data

In Online Continual Learning (OCL) a learning system receives a stream o...

Please sign up or login with your details

Forgot password? Click here to reset