Data-Driven Forecasting of High-Dimensional Chaotic Systems with Long-Short Term Memory Networks

02/21/2018
by   Pantelis R. Vlachas, et al.
0

We introduce a data-driven forecasting method for high dimensional, chaotic systems using Long-Short Term Memory (LSTM) recurrent neural networks. The proposed LSTM neural networks perform inference of high dimensional dynamical systems in their reduced order space and are shown to be an effective set of non-linear approximators of their attractor. We demonstrate the forecasting performance of the LSTM and compare it with Gaussian processes (GPs) in time series obtained from the Lorenz 96 system, the Kuramoto-Sivashinsky equation and a prototype climate model. The LSTM networks outperform the GPs in short-term forecasting accuracy in all applications considered. A hybrid architecture, extending the LSTM with a mean stochastic model (MSM-LSTM), is proposed to ensure convergence to the invariant measure. This novel hybrid method is fully data-driven and extends the forecasting capabilities of LSTM networks.

READ FULL TEXT

page 1

page 13

page 18

page 19

research
11/02/2020

Time Series Forecasting with Stacked Long Short-Term Memory Networks

Long Short-Term Memory (LSTM) networks are often used to capture tempora...
research
01/21/2020

A hybrid model based on deep LSTM for predicting high-dimensional chaotic systems

We propose a hybrid method combining the deep long short-term memory (LS...
research
04/05/2019

Short note on the behavior of recurrent neural network for noisy dynamical system

The behavior of recurrent neural network for the data-driven simulation ...
research
10/31/2019

A Dynamically Controlled Recurrent Neural Network for Modeling Dynamical Systems

This work proposes a novel neural network architecture, called the Dynam...
research
04/18/2018

Improving Long-Horizon Forecasts with Expectation-Biased LSTM Networks

State-of-the-art forecasting methods using Recurrent Neural Net- works (...
research
11/11/2021

Observation Error Covariance Specification in Dynamical Systems for Data assimilation using Recurrent Neural Networks

Data assimilation techniques are widely used to predict complex dynamica...

Please sign up or login with your details

Forgot password? Click here to reset