A Distributed Neural Network Architecture for Robust Non-Linear Spatio-Temporal Prediction

12/23/2019
by   Matthias Karlbauer, et al.
0

We introduce a distributed spatio-temporal artificial neural network architecture (DISTANA). It encodes mesh nodes using recurrent, neural prediction kernels (PKs), while neural transition kernels (TKs) transfer information between neighboring PKs, together modeling and predicting spatio-temporal time series dynamics. As a consequence, DISTANA assumes that generally applicable causes, which may be locally modified, generate the observed data. DISTANA learns in a parallel, spatially distributed manner, scales to large problem spaces, is capable of approximating complex dynamics, and is particularly robust to overfitting when compared to other competitive ANN models. Moreover, it is applicable to heterogeneously structured meshes.

READ FULL TEXT
research
08/17/2019

Chaotic Time Series Prediction using Spatio-Temporal RBF Neural Networks

Due to the dynamic nature, chaotic time series are difficult predict. In...
research
09/19/2020

Inferring, Predicting, and Denoising Causal Wave Dynamics

The novel DISTributed Artificial neural Network Architecture (DISTANA) i...
research
09/21/2020

Hidden Latent State Inference in a Spatio-Temporal Generative Model

Knowledge of the hidden factors that determine particular system dynamic...
research
08/01/2018

Mod-DeepESN: Modular Deep Echo State Network

Neuro-inspired recurrent neural network algorithms, such as echo state n...
research
08/04/2019

Spatio-Temporal RBF Neural Networks

Herein, we propose a spatio-temporal extension of RBFNN for nonlinear sy...
research
03/02/2022

Parallel Spatio-Temporal Attention-Based TCN for Multivariate Time Series Prediction

As industrial systems become more complex and monitoring sensors for eve...
research
12/26/2017

Chaos-guided Input Structuring for Improved Learning in Recurrent Neural Networks

Anatomical studies demonstrate that brain reformats input information to...

Please sign up or login with your details

Forgot password? Click here to reset