Using Data Assimilation to Train a Hybrid Forecast System that Combines Machine-Learning and Knowledge-Based Components

by   Alexander Wikner, et al.

We consider the problem of data-assisted forecasting of chaotic dynamical systems when the available data is in the form of noisy partial measurements of the past and present state of the dynamical system. Recently there have been several promising data-driven approaches to forecasting of chaotic dynamical systems using machine learning. Particularly promising among these are hybrid approaches that combine machine learning with a knowledge-based model, where a machine-learning technique is used to correct the imperfections in the knowledge-based model. Such imperfections may be due to incomplete understanding and/or limited resolution of the physical processes in the underlying dynamical system, e.g., the atmosphere or the ocean. Previously proposed data-driven forecasting approaches tend to require, for training, measurements of all the variables that are intended to be forecast. We describe a way to relax this assumption by combining data assimilation with machine learning. We demonstrate this technique using the Ensemble Transform Kalman Filter (ETKF) to assimilate synthetic data for the 3-variable Lorenz system and for the Kuramoto-Sivashinsky system, simulating model error in each case by a misspecified parameter value. We show that by using partial measurements of the state of the dynamical system, we can train a machine learning model to improve predictions made by an imperfect knowledge-based model.



There are no comments yet.


page 3

page 22


Hybrid Forecasting of Chaotic Processes: Using Machine Learning in Conjunction with a Knowledge-Based Model

A model-based approach to forecasting chaotic dynamical systems utilizes...

Supervised learning from noisy observations: Combining machine-learning techniques with data assimilation

Data-driven prediction and physics-agnostic machine-learning methods hav...

A Framework for Machine Learning of Model Error in Dynamical Systems

The development of data-informed predictive models for dynamical systems...

Augmenting Physical Models with Deep Networks for Complex Dynamics Forecasting

Forecasting complex dynamical phenomena in settings where only partial k...

Data-Driven Substructuring Technique for Pseudo-Dynamic Hybrid Simulation of Steel Braced Frames

This paper proposes a new substructuring technique for hybrid simulation...

Bridging Physics-based and Data-driven modeling for Learning Dynamical Systems

How can we learn a dynamical system to make forecasts, when some variabl...

DAN – An optimal Data Assimilation framework based on machine learning Recurrent Networks

Data assimilation algorithms aim at forecasting the state of a dynamical...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.