Wearable-based Human Activity Recognition with Spatio-Temporal Spiking Neural Networks

11/14/2022
by   Yuhang Li, et al.
0

We study the Human Activity Recognition (HAR) task, which predicts user daily activity based on time series data from wearable sensors. Recently, researchers use end-to-end Artificial Neural Networks (ANNs) to extract the features and perform classification in HAR. However, ANNs pose a huge computation burden on wearable devices and lack temporal feature extraction. In this work, we leverage Spiking Neural Networks (SNNs)–an architecture inspired by biological neurons–to HAR tasks. SNNs allow spatio-temporal extraction of features and enjoy low-power computation with binary spikes. We conduct extensive experiments on three HAR datasets with SNNs, demonstrating that SNNs are on par with ANNs in terms of accuracy while reducing up to 94 code is publicly available in https://github.com/Intelligent-Computing-Lab-Yale/SNN_HAR

READ FULL TEXT
research
03/27/2020

Convolutional Spiking Neural Networks for Spatio-Temporal Feature Extraction

Spiking neural networks (SNNs) can be used in low-power and embedded sys...
research
09/22/2022

Heterogeneous Recurrent Spiking Neural Network for Spatio-Temporal Classification

Spiking Neural Networks are often touted as brain-inspired learning mode...
research
09/29/2022

Evaluating the temporal understanding of neural networks on event-based action recognition with DVS-Gesture-Chain

Enabling artificial neural networks (ANNs) to have temporal understandin...
research
11/10/2021

Keys to Accurate Feature Extraction Using Residual Spiking Neural Networks

Spiking neural networks (SNNs) have become an interesting alternative to...
research
05/02/2020

Deep ConvLSTM with self-attention for human activity decoding using wearables

Decoding human activity accurately from wearable sensors can aid in appl...
research
10/14/2022

MMTSA: Multimodal Temporal Segment Attention Network for Efficient Human Activity Recognition

Multimodal sensors (e.g., visual, non-visual, and wearable) provide comp...
research
11/07/2017

Latent hypernet: Exploring all Layers from Convolutional Neural Networks

Since Convolutional Neural Networks (ConvNets) are able to simultaneousl...

Please sign up or login with your details

Forgot password? Click here to reset