MARS: Mixed Virtual and Real Wearable Sensors for Human Activity Recognition with Multi-Domain Deep Learning Model

09/20/2020
by   Ling Pei, et al.
17

Human activity recognition (HAR) using wearable Inertial Measurement Unit (IMU) sensors is a promising technology for many research areas. Recently, deep learning-based methods pave a new way of understanding and performing analysis of the complex data in the HAR system. However, the performance of these methods is mostly based on the quality and quantity of the collected data. In this paper, we innovatively propose to build a large database based on virtual IMUs and then address technical issues by introducing a multiple-domain deep learning framework consisting of three technical parts. In the first part, we propose to learn the single-frame human activity from the noisy IMU data with hybrid convolutional neural networks (CNNs) in the semi-supervised form. For the second part, the extracted data features are fused according to the principle of uncertainty-aware consistency, which reduces the uncertainty by weighting the importance of the features. The transfer learning is performed in the last part based on the newly released Archive of Motion Capture as Surface Shapes (AMASS) dataset, containing abundant synthetic human poses, which enhances the variety and diversity of the training dataset and is beneficial for the process of training and feature transfer in the proposed method. The efficiency and effectiveness of the proposed method have been demonstrated in the real deep inertial poser (DIP) dataset. The experimental results show that the proposed methods can surprisingly converge within a few iterations and outperform all competing methods.

READ FULL TEXT

page 1

page 5

page 9

page 11

research
03/04/2020

A Deep Learning Method for Complex Human Activity Recognition Using Virtual Wearable Sensors

Sensor-based human activity recognition (HAR) is now a research hotspot ...
research
01/25/2018

Personalized Human Activity Recognition Using Convolutional Neural Networks

A major barrier to the personalized Human Activity Recognition using wea...
research
09/14/2022

TASKED: Transformer-based Adversarial learning for human activity recognition using wearable sensors via Self-KnowledgE Distillation

Wearable sensor-based human activity recognition (HAR) has emerged as a ...
research
04/07/2023

Domain Adaptation for Inertial Measurement Unit-based Human Activity Recognition: A Survey

Machine learning-based wearable human activity recognition (WHAR) models...
research
02/21/2022

CROMOSim: A Deep Learning-based Cross-modality Inertial Measurement Simulator

With the prevalence of wearable devices, inertial measurement unit (IMU)...
research
10/18/2022

BIOWISH: Biometric Recognition using Wearable Inertial Sensors detecting Heart Activity

Wearable devices are increasingly used, thanks to the wide set of applic...
research
06/28/2023

Toward Pioneering Sensors and Features Using Large Language Models in Human Activity Recognition

In this paper, we propose a feature pioneering method using Large Langua...

Please sign up or login with your details

Forgot password? Click here to reset