Evolino for recurrent support vector machines

12/15/2005
by   Juergen Schmidhuber, et al.
0

Traditional Support Vector Machines (SVMs) need pre-wired finite time windows to predict and classify time series. They do not have an internal state necessary to deal with sequences involving arbitrary long-term dependencies. Here we introduce a new class of recurrent, truly sequential SVM-like devices with internal adaptive states, trained by a novel method called EVOlution of systems with KErnel-based outputs (Evoke), an instance of the recent Evolino class of methods. Evoke evolves recurrent neural networks to detect and represent temporal dependencies while using quadratic programming/support vector regression to produce precise outputs. Evoke is the first SVM-based mechanism learning to classify a context-sensitive language. It also outperforms recent state-of-the-art gradient-based recurrent neural networks (RNNs) on various time series prediction tasks.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/16/2020

A fast noise filtering algorithm for time series prediction using recurrent neural networks

Recent research demonstrate that prediction of time series by recurrent ...
research
05/01/2021

Comprehensive Review On Twin Support Vector Machines

Twin support vector machine (TSVM) and twin support vector regression (T...
research
07/21/2016

Distributed Supervised Learning using Neural Networks

Distributed learning is the problem of inferring a function in the case ...
research
10/25/2017

Unsupervised and Semi-supervised Anomaly Detection with LSTM Neural Networks

We investigate anomaly detection in an unsupervised framework and introd...
research
03/01/2017

L^3-SVMs: Landmarks-based Linear Local Support Vectors Machines

For their ability to capture non-linearities in the data and to scale to...
research
10/31/2015

Support Vector Regression, Smooth Splines, and Time Series Prediction

Prediction of dynamical time series with additive noise using support ve...

Please sign up or login with your details

Forgot password? Click here to reset