Posture and sequence recognition for Bharatanatyam dance performances using machine learning approach

09/24/2019
by   Tanwi Mallick, et al.
7

Understanding the underlying semantics of performing arts like dance is a challenging task. Dance is multimedia in nature and spans over time as well as space. Capturing and analyzing the multimedia content of the dance is useful for the preservation of cultural heritage, to build video recommendation systems, to assist learners to use tutoring systems. To develop an application for dance, three aspects of dance analysis need to be addressed: 1) Segmentation of the dance video to find the representative action elements, 2) Matching or recognition of the detected action elements, and 3) Recognition of the dance sequences formed by combining a number of action elements under certain rules. This paper attempts to solve three fundamental problems of dance analysis for understanding the underlying semantics of dance forms. Our focus is on an Indian Classical Dance (ICD) form known as Bharatanatyam. As dance is driven by music, we use the music as well as motion information for key posture extraction. Next, we recognize the key postures using machine learning as well as deep learning techniques. Finally, the dance sequence is recognized using the Hidden Markov Model (HMM). We capture the multi-modal data of Bharatanatyam dance using Kinect and build an annotated data set for research in ICD.

READ FULL TEXT

page 4

page 6

page 7

page 11

page 13

page 14

research
04/17/2020

Beat Detection and Automatic Annotation of the Music of Bharatanatyam Dance using Speech Recognition Techniques

Bharatanatyam, an Indian Classical Dance form, represents the rich cultu...
research
04/24/2020

Bharatanatyam Dance Transcription using Multimedia Ontology and Machine Learning

Indian Classical Dance is an over 5000 years' old multi-modal language f...
research
04/03/2018

Music Genre Classification using Machine Learning Techniques

Categorizing music files according to their genre is a challenging task ...
research
09/04/2018

Music Sequence Prediction with Mixture Hidden Markov Models

Recommendation systems that automatically generate personalized music pl...
research
10/06/2017

CAMREP- Concordia Action and Motion Repository

Action recognition, motion classification, gait analysis and synthesis a...
research
08/13/2015

Generation of Multimedia Artifacts: An Extractive Summarization-based Approach

We explore methods for content selection and address the issue of cohere...
research
01/20/2023

Screen Correspondence: Mapping Interchangeable Elements between UIs

Understanding user interface (UI) functionality is a useful yet challeng...

Please sign up or login with your details

Forgot password? Click here to reset