A Machine Learning Approach to Adaptive Covariance Localization

01/02/2018
by   Azam Moosavi, et al.
0

Data assimilation plays a key role in large-scale atmospheric weather forecasting, where the state of the physical system is estimated from model outputs and observations, and is then used as initial condition to produce accurate future forecasts. The Ensemble Kalman Filter (EnKF) provides a practical implementation of the statistical solution of the data assimilation problem and has gained wide popularity as. This success can be attributed to its simple formulation and ease of implementation. EnKF is a Monte-Carlo algorithm that solves the data assimilation problem by sampling the probability distributions involved in Bayes theorem. Because of this, all flavors of EnKF are fundamentally prone to sampling errors when the ensemble size is small. In typical weather forecasting applications, the model state space has dimension 10^9-10^12, while the ensemble size typically ranges between 30-100 members. Sampling errors manifest themselves as long-range spurious correlations and have been shown to cause filter divergence. To alleviate this effect covariance localization dampens spurious correlations between state variables located at a large distance in the physical space, via an empirical distance-dependent function. The quality of the resulting analysis and forecast is greatly influenced by the choice of the localization function parameters, e.g., the radius of influence. The localization radius is generally tuned empirically to yield desirable results.This work, proposes two adaptive algorithms for covariance localization in the EnKF framework, both based on a machine learning approach. The first algorithm adapts the localization radius in time, while the second algorithm tunes the localization radius in both time and space. Numerical experiments carried out with the Lorenz-96 model, and a quasi-geostrophic model, reveal the potential of the proposed machine learning approaches.

READ FULL TEXT

page 10

page 12

page 14

page 15

research
06/27/2018

An Optimal Experimental Design Framework for Adaptive Inflation and Covariance Localization for Ensemble Filters

Covariance inflation and localization are ubiquitously employed to count...
research
06/09/2022

Deep learning-enhanced ensemble-based data assimilation for high-dimensional nonlinear dynamical systems

Data assimilation (DA) is a key component of many forecasting models in ...
research
09/24/2018

A Bayesian Approach to Multivariate Adaptive Localization in Ensemble-Based Data Assimilation with Time-Dependent Extensions

Ever since its inception, the Ensemble Kalman Filter has elicited many h...
research
05/31/2020

What limits the number of observations that can be effectively assimilated by EnKF?

The ability of ensemble Kalman filter (EnKF) algorithms to extract infor...
research
05/12/2023

Online machine-learning forecast uncertainty estimation for sequential data assimilation

Quantifying forecast uncertainty is a key aspect of state-of-the-art num...
research
01/31/2020

A graph clustering approach to localization for adaptive covariance tuning in data assimilation based on state-observation mapping

An original graph clustering approach to efficient localization of error...
research
04/13/2021

Simpler Certified Radius Maximization by Propagating Covariances

One strategy for adversarially training a robust model is to maximize it...

Please sign up or login with your details

Forgot password? Click here to reset