Observation Error Covariance Specification in Dynamical Systems for Data assimilation using Recurrent Neural Networks

11/11/2021
by   Sibo Cheng, et al.
17

Data assimilation techniques are widely used to predict complex dynamical systems with uncertainties, based on time-series observation data. Error covariance matrices modelling is an important element in data assimilation algorithms which can considerably impact the forecasting accuracy. The estimation of these covariances, which usually relies on empirical assumptions and physical constraints, is often imprecise and computationally expensive especially for systems of large dimension. In this work, we propose a data-driven approach based on long short term memory (LSTM) recurrent neural networks (RNN) to improve both the accuracy and the efficiency of observation covariance specification in data assimilation for dynamical systems. Learning the covariance matrix from observed/simulated time-series data, the proposed approach does not require any knowledge or assumption about prior error distribution, unlike classical posterior tuning methods. We have compared the novel approach with two state-of-the-art covariance tuning algorithms, namely DI01 and D05, first in a Lorenz dynamical system and then in a 2D shallow water twin experiments framework with different covariance parameterization using ensemble assimilation. This novel method shows significant advantages in observation covariance specification, assimilation accuracy and computational efficiency.

READ FULL TEXT

page 8

page 13

page 15

page 17

research
02/21/2018

Data-Driven Forecasting of High-Dimensional Chaotic Systems with Long-Short Term Memory Networks

We introduce a data-driven forecasting method for high dimensional, chao...
research
03/04/2020

Forecasting Sequential Data using Consistent Koopman Autoencoders

Recurrent neural networks are widely used on time series data, yet such ...
research
06/09/2021

Observation data compression for variational assimilation of dynamical systems

Accurate estimation of error covariances (both background and observatio...
research
10/11/2019

Background Error Covariance Iterative Updating with Invariant Observation Measures for Data Assimilation

In order to leverage the information embedded in the background state an...
research
04/30/2020

Data-Space Inversion Using a Recurrent Autoencoder for Time-Series Parameterization

Data-space inversion (DSI) and related procedures represent a family of ...
research
03/03/2023

Neural Operator Learning for Long-Time Integration in Dynamical Systems with Recurrent Neural Networks

Deep neural networks are an attractive alternative for simulating comple...
research
07/15/2019

Deciphering Dynamical Nonlinearities in Short Time Series Using Recurrent Neural Networks

Surrogate testing techniques have been used widely to investigate the pr...

Please sign up or login with your details

Forgot password? Click here to reset