LSTM Fully Convolutional Networks for Time Series Classification

09/08/2017
by   Fazle Karim, et al.
0

Fully convolutional neural networks (FCN) have been shown to achieve state-of-the-art performance on the task of classifying time series sequences. We propose the augmentation of fully convolutional networks with long short term memory recurrent neural network (LSTM RNN) sub-modules for time series classification. Our proposed models significantly enhance the performance of fully convolutional networks with a nominal increase in model size and require minimal preprocessing of the dataset. The proposed Long Short Term Memory Fully Convolutional Network (LSTM-FCN) achieves state-of-the-art performance compared to others. We also explore the usage of attention mechanism to improve time series classification with the Attention Long Short Term Memory Fully Convolutional Network (ALSTM-FCN). Utilization of the attention mechanism allows one to visualize the decision process of the LSTM cell. Furthermore, we propose fine-tuning as a method to enhance the performance of trained models. An overall analysis of the performance of our model is provided and compared to other techniques.

READ FULL TEXT
research
02/27/2019

Insights into LSTM Fully Convolutional Networks for Time Series Classification

Long Short Term Memory Fully Convolutional Neural Networks (LSTM-FCN) an...
research
08/03/2015

Time-series modeling with undecimated fully convolutional neural networks

We present a new convolutional neural network-based time-series model. T...
research
07/05/2023

Multivariate Time Series Classification: A Deep Learning Approach

This paper investigates different methods and various neural network arc...
research
10/30/2018

Long Short-Term Attention

In order to learn effective features from temporal sequences, the long s...
research
11/10/2017

Attend and Diagnose: Clinical Time Series Analysis using Attention Models

With widespread adoption of electronic health records, there is an incre...
research
01/11/2021

Condition Assessment of Stay Cables through Enhanced Time Series Classification Using a Deep Learning Approach

This study proposes a data-driven method that detects cable damage from ...
research
08/16/2018

LARNN: Linear Attention Recurrent Neural Network

The Linear Attention Recurrent Neural Network (LARNN) is a recurrent att...

Please sign up or login with your details

Forgot password? Click here to reset