State, global and local parameter estimation using local ensemble Kalman filters: applications to online machine learning of chaotic dynamics

07/23/2021
by   Quentin Malartic, et al.
0

In a recent methodological paper, we have shown how to learn chaotic dynamics along with the state trajectory from sequentially acquired observations, using local ensemble Kalman filters. Here, we more systematically investigate the possibilty to use a local ensemble Kalman filter with either covariance localization or local domains, in order to retrieve the state and a mix of key global and local parameters. Global parameters are meant to represent the surrogate dynamics, for instance through a neural network, which is reminiscent of data-driven machine learning of dynamics, while the local parameters typically stand for the forcings of the model. A family of algorithms for covariance and local domain localization is proposed in this joint state and parameter filter context. In particular, we show how to rigorously update global parameters using a local domain EnKF such as the LETKF, an inherently local method. The approach is tested with success on the 40-variable Lorenz model using several of the local EnKF flavors. A two-dimensional illustration based on a multi-layer Lorenz model is finally provided. It uses radiance-like non-local observations, and both local domains and covariance localization in order to learn the chaotic dynamics, the local forcings, and the couplings between layers. This paper more generally addresses the key question of online estimation of both global and local model parameters.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/06/2020

Online learning of both state and dynamics using ensemble Kalman filters

The reconstruction of the dynamics of an observed physical system as a s...
research
06/07/2022

Continuous Hyper-parameter OPtimization (CHOP) in an ensemble Kalman filter

Practical data assimilation algorithms often contain hyper-parameters, w...
research
07/27/2018

Inference of stochastic parameterizations for model error treatment using nested ensemble Kalman filters

Stochastic parameterizations are increasingly being used to represent th...
research
04/26/2021

Online parameter inference for the simulation of a Bunsen flame using heteroscedastic Bayesian neural network ensembles

This paper proposes a Bayesian data-driven machine learning method for t...
research
05/31/2020

What limits the number of observations that can be effectively assimilated by EnKF?

The ability of ensemble Kalman filter (EnKF) algorithms to extract infor...
research
03/16/2021

SymPKF: a symbolic and computational toolbox for the design of parametric Kalman filter dynamics

Recent researches in data assimilation lead to the introduction of the p...
research
02/29/2020

A Stochastic Covariance Shrinkage Approach in Ensemble Transform Kalman Filtering

Operational Ensemble Kalman Filtering (EnKF) methods rely on model-speci...

Please sign up or login with your details

Forgot password? Click here to reset