A Novel Multi-Stage Training Approach for Human Activity Recognition from Multimodal Wearable Sensor Data Using Deep Neural Network

by   Tanvir Mahmud, et al.

Deep neural network is an effective choice to automatically recognize human actions utilizing data from various wearable sensors. These networks automate the process of feature extraction relying completely on data. However, various noises in time series data with complex inter-modal relationships among sensors make this process more complicated. In this paper, we have proposed a novel multi-stage training approach that increases diversity in this feature extraction process to make accurate recognition of actions by combining varieties of features extracted from diverse perspectives. Initially, instead of using single type of transformation, numerous transformations are employed on time series data to obtain variegated representations of the features encoded in raw data. An efficient deep CNN architecture is proposed that can be individually trained to extract features from different transformed spaces. Later, these CNN feature extractors are merged into an optimal architecture finely tuned for optimizing diversified extracted features through a combined training stage or multiple sequential training stages. This approach offers the opportunity to explore the encoded features in raw sensor data utilizing multifarious observation windows with immense scope for efficient selection of features for final convergence. Extensive experimentations have been carried out in three publicly available datasets that provide outstanding performance consistently with average five-fold cross-validation accuracy of 99.29 HAR database, 99.02 outperforming other state-of-the-art approaches.


page 1

page 3

page 7

page 12


PerceptionNet: A Deep Convolutional Neural Network for Late Sensor Fusion

Human Activity Recognition (HAR) based on motion sensors has drawn a lot...

SFFDD: Deep Neural Network with Enriched Features for Failure Prediction with Its Application to Computer Disk Driver

A classification technique incorporating a novel feature derivation meth...

Exercise Motion Classification from Large-Scale Wearable Sensor Data Using Convolutional Neural Networks

The ability to accurately identify human activities is essential for dev...

An Examination of Wearable Sensors and Video Data Capture for Human Exercise Classification

Wearable sensors such as Inertial Measurement Units (IMUs) are often use...

A Multi-Media Exchange Format for Time-Series Dataset Curation

Exchanging data as character-separated values (CSV) is slow, cumbersome ...

Automatic Diagnosis of Malaria from Thin Blood Smear Images using Deep Convolutional Neural Network with Multi-Resolution Feature Fusion

Malaria, a life-threatening disease, infects millions of people every ye...

Classifying and Visualizing Motion Capture Sequences using Deep Neural Networks

The gesture recognition using motion capture data and depth sensors has ...

Please sign up or login with your details

Forgot password? Click here to reset