Continuous Hyper-parameter OPtimization (CHOP) in an ensemble Kalman filter

06/07/2022
by   Xiaodong Luo, et al.
0

Practical data assimilation algorithms often contain hyper-parameters, which may arise due to, for instance, the use of certain auxiliary techniques like covariance inflation and localization in an ensemble Kalman filter, the re-parameterization of certain quantities such as model and/or observation error covariance matrices, and so on. Given the richness of the established assimilation algorithms, and the abundance of the approaches through which hyper-parameters are introduced to the assimilation algorithms, one may ask whether it is possible to develop a sound and generic method to efficiently choose various types of (sometimes high-dimensional) hyper-parameters. This work aims to explore a feasible, although likely partial, answer to this question. Our main idea is built upon the notion that a data assimilation algorithm with hyper-parameters can be considered as a parametric mapping that links a set of quantities of interest (e.g., model state variables and/or parameters) to a corresponding set of predicted observations in the observation space. As such, the choice of hyper-parameters can be recast as a parameter estimation problem, in which our objective is to tune the hyper-parameters in such a way that the resulted predicted observations can match the real observations to a good extent. From this perspective, we propose a hyper-parameter estimation workflow and investigate the performance of this workflow in an ensemble Kalman filter. In a series of experiments, we observe that the proposed workflow works efficiently even in the presence of a relatively large amount (up to 10^3) of hyper-parameters, and exhibits reasonably good and consistent performance under various conditions.

READ FULL TEXT

page 13

page 14

page 15

page 21

research
01/03/2022

Frequentist perspective on robust parameter estimation using the ensemble Kalman filter

Standard maximum likelihood or Bayesian approaches to parameter estimati...
research
08/04/2021

Investigating the Pilot Point Ensemble Kalman Filter for geostatistical inversion and data assimilation

Parameter estimation has a high importance in the geosciences. The ensem...
research
07/10/2020

Analyzing the Effects of Observation Function Selection in Ensemble Kalman Filtering for Epidemic Models

The Ensemble Kalman Filter (EnKF) is a Bayesian filtering algorithm util...
research
06/27/2018

An Optimal Experimental Design Framework for Adaptive Inflation and Covariance Localization for Ensemble Filters

Covariance inflation and localization are ubiquitously employed to count...
research
07/06/2011

Integrating Generic Sensor Fusion Algorithms with Sound State Representations through Encapsulation of Manifolds

Common estimation algorithms, such as least squares estimation or the Ka...
research
04/29/2019

Assimilation of semi-qualitative sea ice thickness data with the EnKF-SQ

A newly introduced stochastic data assimilation method, the Ensemble Kal...

Please sign up or login with your details

Forgot password? Click here to reset