Predictive Neural Networks

02/09/2018
by   Frieder Stolzenburg, et al.
0

Recurrent neural networks are a powerful means to cope with time series. We show that already linearly activated recurrent neural networks can approximate any time-dependent function f(t) given by a number of function values. The approximation can effectively be learned by simply solving a linear equation system; no backpropagation or similar methods are needed. Furthermore the network size can be reduced by taking only the most relevant components of the network. Thus, in contrast to others, our approach not only learns network weights but also the network architecture. The networks have interesting properties: In the stationary case they end up in ellipse trajectories in the long run, and they allow the prediction of further values and compact representations of functions. We demonstrate this by several experiments, among them multiple superimposed oscillators (MSO) and robotic soccer. Predictive neural networks outperform the previous state-of-the-art for the MSO task with a minimal number of units.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/16/2020

A fast noise filtering algorithm for time series prediction using recurrent neural networks

Recent research demonstrate that prediction of time series by recurrent ...
research
10/31/2016

Exploiting Spatio-Temporal Structure with Recurrent Winner-Take-All Networks

We propose a convolutional recurrent neural network, with Winner-Take-Al...
research
05/25/2017

Predictive State Recurrent Neural Networks

We present a new model, Predictive State Recurrent Neural Networks (PSRN...
research
10/05/2020

A fast memoryless predictive algorithm in a chain of recurrent neural networks

In the recent publication (arxiv:2007.08063v2 [cs.LG]) a fast prediction...
research
07/22/2014

Deep Recurrent Neural Networks for Time Series Prediction

Ability of deep networks to extract high level features and of recurrent...
research
03/08/2023

On the Benefits of Biophysical Synapses

The approximation capability of ANNs and their RNN instantiations, is st...
research
06/09/2022

It's a super deal – train recurrent network on noisy data and get smooth prediction free

Recent research demonstrate that prediction of time series by predictive...

Please sign up or login with your details

Forgot password? Click here to reset