Nrityantar: Pose oblivious Indian classical dance sequence classification system

12/13/2018
by   Vinay Kaushik, et al.
0

In this paper, we attempt to advance the research work done in human action recognition to a rather specialized application namely Indian Classical Dance (ICD) classification. The variation in such dance forms in terms of hand and body postures, facial expressions or emotions and head orientation makes pose estimation an extremely challenging task. To circumvent this problem, we construct a pose-oblivious shape signature which is fed to a sequence learning framework. The pose signature representation is done in two-fold process. First, we represent person-pose in first frame of a dance video using symmetric Spatial Transformer Networks (STN) to extract good person object proposals and CNN-based parallel single person pose estimator (SPPE). Next, the pose basis are converted to pose flows by assigning a similarity score between successive poses followed by non-maximal suppression. Instead of feeding a simple chain of joints in the sequence learner which generally hinders the network performance we constitute a feature vector of the normalized distance vectors, flow, angles between anchor joints which captures the adjacency configuration in the skeletal pattern. Thus, the kinematic relationship amongst the body joints across the frames using pose estimation helps in better establishing the spatio-temporal dependencies. We present an exhaustive empirical evaluation of state-of-the-art deep network based methods for dance classification on ICD dataset.

READ FULL TEXT

page 2

page 4

research
05/11/2018

Joint Flow: Temporal Flow Fields for Multi Person Tracking

In this work we propose an online multi person pose tracker which works ...
research
12/01/2016

RMPE: Regional Multi-person Pose Estimation

Multi-person pose estimation in the wild is challenging. Although state-...
research
03/16/2023

PSVT: End-to-End Multi-person 3D Pose and Shape Estimation with Progressive Video Transformers

Existing methods of multi-person video 3D human Pose and Shape Estimatio...
research
11/23/2017

Exploiting temporal information for 3D pose estimation

In this work, we address the problem of 3D human pose estimation from a ...
research
09/18/2017

Multi-Person Pose Estimation via Column Generation

We study the problem of multi-person pose estimation in natural images. ...
research
06/14/2023

TryOnDiffusion: A Tale of Two UNets

Given two images depicting a person and a garment worn by another person...
research
08/01/2019

Falls Prediction Based on Body Keypoints and Seq2Seq Architecture

This paper presents a novel approach for predicting falls event in advan...

Please sign up or login with your details

Forgot password? Click here to reset