Data-driven prediction of a multi-scale Lorenz 96 chaotic system using a hierarchy of deep learning methods: Reservoir computing, ANN, and RNN-LSTM

06/20/2019
by   Ashesh Chattopadhyay, et al.
2

In this paper, the performance of three deep learning methods for predicting short-term evolution and reproducing the long-term statistics of a multi-scale spatio-temporal Lorenz 96 system is examined. The three methods are: echo state network (a type of reservoir computing, RC-ESN), deep feed-forward artificial neural network (ANN), and recurrent neural network with long short-term memory (RNN-LSTM). This Lorenz system has three tiers of nonlinearly interacting variables representing slow/large-scale (X), intermediate (Y), and fast/small-scale (Z) processes. For training or testing, only X is available, and Y and Z are never known/used. It is shown that RC-ESN substantially outperforms ANN and RNN-LSTM for short-term prediction, e.g., accurately forecasting the chaotic trajectories for hundreds of numerical solver's time steps, equivalent to several Lyapunov timescales. ANN (RNN-LSTM) shows some (little) prediction skills. It is also shown that even after losing the trajectory, data predicted by RC-ESN have a probability density function (PDF) that closely matches the true PDF, even at the tails. PDFs of the data predicted by ANN or RNN-LSTM do not match the true PDF. Implications of the findings, caveats, and applications to data-driven and inexact, data-assisted surrogate modeling of complex dynamical systems such as weather/climate are discussed.

READ FULL TEXT
research
02/21/2018

Data-Driven Forecasting of High-Dimensional Chaotic Systems with Long-Short Term Memory Networks

We introduce a data-driven forecasting method for high dimensional, chao...
research
02/25/2020

Data-driven super-parameterization using deep learning: Experimentation with multi-scale Lorenz 96 systems and transfer-learning

To make weather/climate modeling computationally affordable, small-scale...
research
04/13/2023

Neural Network Architectures for Optical Channel Nonlinear Compensation in Digital Subcarrier Multiplexing Systems

In this work, we propose to use various artificial neural network (ANN) ...
research
02/02/2018

Short-term Memory of Deep RNN

The extension of deep learning towards temporal data processing is gaini...
research
12/16/2021

A Statistics and Deep Learning Hybrid Method for Multivariate Time Series Forecasting and Mortality Modeling

Hybrid methods have been shown to outperform pure statistical and pure d...
research
12/12/2019

DeepAuto: A Hierarchical Deep Learning Framework for Real-Time Prediction in Cellular Networks

Accurate real-time forecasting of key performance indicators (KPIs) is a...
research
06/12/2021

Short-term forecasting of global solar irradiance with incomplete data

Accurate mechanisms for forecasting solar irradiance and insolation prov...

Please sign up or login with your details

Forgot password? Click here to reset