Skeleton Based Action Recognition using a Stacked Denoising Autoencoder with Constraints of Privileged Information

03/12/2020
by   Zhize Wu, et al.
0

Recently, with the availability of cost-effective depth cameras coupled with real-time skeleton estimation, the interest in skeleton-based human action recognition is renewed. Most of the existing skeletal representation approaches use either the joint location or the dynamics model. Differing from the previous studies, we propose a new method called Denoising Autoencoder with Temporal and Categorical Constraints (DAE_CTC) to study the skeletal representation in a view of skeleton reconstruction. Based on the concept of learning under privileged information, we integrate action categories and temporal coordinates into a stacked denoising autoencoder in the training phase, to preserve category and temporal feature, while learning the hidden representation from a skeleton. Thus, we are able to improve the discriminative validity of the hidden representation. In order to mitigate the variation resulting from temporary misalignment, a new method of temporal registration, called Locally-Warped Sequence Registration (LWSR), is proposed for registering the sequences of inter- and intra-class actions. We finally represent the sequences using a Fourier Temporal Pyramid (FTP) representation and perform classification using a combination of LWSR registration, FTP representation, and a linear Support Vector Machine (SVM). The experimental results on three action data sets, namely MSR-Action3D, UTKinect-Action, and Florence3D-Action, show that our proposal performs better than many existing methods and comparably to the state of the art.

READ FULL TEXT

page 31

page 32

research
03/09/2017

A New Representation of Skeleton Sequences for 3D Action Recognition

This paper presents a new method for 3D action recognition with skeleton...
research
11/27/2017

Highly Efficient Human Action Recognition with Quantum Genetic Algorithm Optimized Support Vector Machine

In this paper we propose the use of quantum genetic algorithm to optimiz...
research
05/24/2021

Real-time Human Action Recognition Using Locally Aggregated Kinematic-Guided Skeletonlet and Supervised Hashing-by-Analysis Model

3D action recognition is referred to as the classification of action seq...
research
04/20/2015

Learning discriminative trajectorylet detector sets for accurate skeleton-based action recognition

The introduction of low-cost RGB-D sensors has promoted the research in ...
research
04/17/2018

Co-occurrence Feature Learning from Skeleton Data for Action Recognition and Detection with Hierarchical Aggregation

Skeleton-based human action recognition has recently drawn increasing at...
research
02/01/2016

Combining ConvNets with Hand-Crafted Features for Action Recognition Based on an HMM-SVM Classifier

This paper proposes a new framework for RGB-D-based action recognition t...
research
07/15/2019

Slow Feature Analysis for Human Action Recognition

Slow Feature Analysis (SFA) extracts slowly varying features from a quic...

Please sign up or login with your details

Forgot password? Click here to reset