Investigation of Different Skeleton Features for CNN-based 3D Action Recognition

05/02/2017
by   Zewei Ding, et al.
0

Deep learning techniques are being used in skeleton based action recognition tasks and outstanding performance has been reported. Compared with RNN based methods which tend to overemphasize temporal information, CNN-based approaches can jointly capture spatio-temporal information from texture color images encoded from skeleton sequences. There are several skeleton-based features that have proven effective in RNN-based and handcrafted-feature-based methods. However, it remains unknown whether they are suitable for CNN-based approaches. This paper proposes to encode five spatial skeleton features into images with different encoding methods. In addition, the performance implication of different joints used for feature extraction is studied. The proposed method achieved state-of-the-art performance on NTU RGB+D dataset for 3D human action analysis. An accuracy of 75.32% was achieved in Large Scale 3D Human Activity Analysis Challenge in Depth Videos.

READ FULL TEXT
research
07/06/2017

Skeleton-based Action Recognition Using LSTM and CNN

Recent methods based on 3D skeleton data have achieved outstanding perfo...
research
11/16/2017

Skepxels: Spatio-temporal Image Representation of Human Skeleton Joints for Action Recognition

Human skeleton joints are popular for action analysis since they can be ...
research
12/23/2020

Skeleton-based Approaches based on Machine Vision: A Survey

Recently, skeleton-based approaches have achieved rapid progress on the ...
research
01/31/2018

Action Recognition with Visual Attention on Skeleton Images

Action recognition with 3D skeleton sequences is becoming popular due to...
research
03/28/2017

Learning and Refining of Privileged Information-based RNNs for Action Recognition from Depth Sequences

Existing RNN-based approaches for action recognition from depth sequence...
research
04/27/2021

Three-stream network for enriched Action Recognition

Understanding accurate information on human behaviours is one of the mos...
research
11/24/2020

KShapeNet: Riemannian network on Kendall shape space for Skeleton based Action Recognition

Deep Learning architectures, albeit successful in most computer vision t...

Please sign up or login with your details

Forgot password? Click here to reset