Online model error correction with neural networks in the incremental 4D-Var framework

10/25/2022
by   Alban Farchi, et al.
0

Recent studies have demonstrated that it is possible to combine machine learning with data assimilation to reconstruct the dynamics of a physical model partially and imperfectly observed. Data assimilation is used to estimate the system state from the observations, while machine learning computes a surrogate model of the dynamical system based on those estimated states. The surrogate model can be defined as an hybrid combination where a physical model based on prior knowledge is enhanced with a statistical model estimated by a neural network. The training of the neural network is typically done offline, once a large enough dataset of model state estimates is available. By contrast, with online approaches the surrogate model is improved each time a new system state estimate is computed. Online approaches naturally fit the sequential framework encountered in geosciences where new observations become available with time. In a recent methodology paper, we have developed a new weak-constraint 4D-Var formulation which can be used to train a neural network for online model error correction. In the present article, we develop a simplified version of that method, in the incremental 4D-Var framework adopted by most operational weather centres. The simplified method is implemented in the ECMWF Object-Oriented Prediction System, with the help of a newly developed Fortran neural network library, and tested with a two-layer two-dimensional quasi geostrophic model. The results confirm that online learning is effective and yields a more accurate model error correction than offline learning. Finally, the simplified method is compatible with future applications to state-of-the-art models such as the ECMWF Integrated Forecasting System.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/23/2021

A comparison of combined data assimilation and machine learning methods for offline and online model error correction

Recent studies have shown that it is possible to combine machine learnin...
research
06/06/2020

Online learning of both state and dynamics using ensemble Kalman filters

The reconstruction of the dynamics of an observed physical system as a s...
research
10/23/2020

Using machine learning to correct model error in data assimilation and forecast applications

The idea of using machine learning (ML) methods to reconstruct the dynam...
research
11/16/2021

Adjoint-Matching Neural Network Surrogates for Fast 4D-Var Data Assimilation

The data assimilation procedures used in many operational numerical weat...
research
08/28/2023

Rule-Based Error Detection and Correction to Operationalize Movement Trajectory Classification

Classification of movement trajectories has many applications in transpo...
research
04/11/2020

On Error Correction Neural Networks for Economic Forecasting

Recurrent neural networks (RNNs) are more suitable for learning non-line...
research
04/24/2019

Applying machine learning to improve simulations of a chaotic dynamical system using empirical error correction

Dynamical weather and climate prediction models underpin many studies of...

Please sign up or login with your details

Forgot password? Click here to reset