Online machine-learning forecast uncertainty estimation for sequential data assimilation

05/12/2023
by   Maximiliano A. Sacco, et al.
0

Quantifying forecast uncertainty is a key aspect of state-of-the-art numerical weather prediction and data assimilation systems. Ensemble-based data assimilation systems incorporate state-dependent uncertainty quantification based on multiple model integrations. However, this approach is demanding in terms of computations and development. In this work a machine learning method is presented based on convolutional neural networks that estimates the state-dependent forecast uncertainty represented by the forecast error covariance matrix using a single dynamical model integration. This is achieved by the use of a loss function that takes into account the fact that the forecast errors are heterodastic. The performance of this approach is examined within a hybrid data assimilation method that combines a Kalman-like analysis update and the machine learning based estimation of a state-dependent forecast error covariance matrix. Observing system simulation experiments are conducted using the Lorenz'96 model as a proof-of-concept. The promising results show that the machine learning method is able to predict precise values of the forecast covariance matrix in relatively high-dimensional states. Moreover, the hybrid data assimilation method shows similar performance to the ensemble Kalman filter outperforming it when the ensembles are relatively small.

READ FULL TEXT

page 1

page 14

page 17

research
11/29/2021

Evaluation of Machine Learning Techniques for Forecast Uncertainty Quantification

Producing an accurate weather forecast and a reliable quantification of ...
research
06/09/2022

Deep learning-enhanced ensemble-based data assimilation for high-dimensional nonlinear dynamical systems

Data assimilation (DA) is a key component of many forecasting models in ...
research
10/31/2019

Multivariate Uncertainty in Deep Learning

Deep learning is increasingly used for state estimation problems such as...
research
10/18/2022

Fast same-step forecast in SUTSE model and its theoretical properties

We consider the problem of forecasting multivariate time series by a See...
research
10/10/2021

Uncertainty in Data-Driven Kalman Filtering for Partially Known State-Space Models

Providing a metric of uncertainty alongside a state estimate is often cr...
research
01/02/2018

A Machine Learning Approach to Adaptive Covariance Localization

Data assimilation plays a key role in large-scale atmospheric weather fo...

Please sign up or login with your details

Forgot password? Click here to reset