Feature Selection for Multivariate Time Series via Network Pruning

02/11/2021
by   Kang Gu, et al.
0

In recent years, there has been an ever increasing amount of multivariate time series (MTS) data in various domains, typically generated by a large family of sensors such as wearable devices. This has led to the development of novel learning methods on MTS data, with deep learning models dominating the most recent advancements. Prior literature has primarily focused on designing new network architectures for modeling temporal dependencies within MTS. However, a less studied challenge is associated with high dimensionality of MTS data. In this paper, we propose a novel neural component, namely Neural Feature Se-lector (NFS), as an end-2-end solution for feature selection in MTS data. Specifically, NFS is based on decomposed convolution design and includes two modules: firstly each feature stream within MTS is processed by a temporal CNN independently; then an aggregating CNN combines the processed streams to produce input for other downstream networks. We evaluated the proposed NFS model on four real-world MTS datasets and found that it achieves comparable results with state-of-the-art methods while providing the benefit of feature selection. Our paper also highlights the robustness and effectiveness of feature selection with NFS compared to using recent autoencoder-based methods.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/22/2021

A Feature Selection Method for Multi-Dimension Time-Series Data

Time-series data in application areas such as motion capture and activit...
research
06/28/2023

Feature Selection: A perspective on inter-attribute cooperation

High-dimensional datasets depict a challenge for learning tasks in data ...
research
11/22/2018

Feature Selection for Survival Analysis with Competing Risks using Deep Learning

Deep learning models for survival analysis have gained significant atten...
research
10/04/2020

Multivariate Quantile Bayesian Structural Time Series (MQBSTS) Model

In this paper, we propose the multivariate quantile Bayesian structural ...
research
02/28/2019

AFS: An Attention-based mechanism for Supervised Feature Selection

As an effective data preprocessing step, feature selection has shown its...
research
12/22/2017

Dropout Feature Ranking for Deep Learning Models

Deep neural networks are a promising technology achieving state-of-the-a...
research
04/04/2022

Taking ROCKET on an Efficiency Mission: Multivariate Time Series Classification with LightWaveS

Nowadays, with the rising number of sensors in sectors such as healthcar...

Please sign up or login with your details

Forgot password? Click here to reset