Bharatanatyam Dance Transcription using Multimedia Ontology and Machine Learning

04/24/2020
by   Tanwi Mallick, et al.
0

Indian Classical Dance is an over 5000 years' old multi-modal language for expressing emotions. Preservation of dance through multimedia technology is a challenging task. In this paper, we develop a system to generate a parseable representation of a dance performance. The system will help to preserve intangible heritage, annotate performances for better tutoring, and synthesize dance performances. We first attempt to capture the concepts of the basic steps of an Indian Classical Dance form, named Bharatanatyam Adavus, in an ontological model. Next, we build an event-based low-level model that relates the ontology of Adavus to the ontology of multi-modal data streams (RGB-D of Kinect in this case) for a computationally realizable framework. Finally, the ontology is used for transcription into Labanotation. We also present a transcription tool for encoding the performances of Bharatanatyam Adavus to Labanotation and test it on our recorded data set. Our primary aim is to document the complex movements of dance in terms of Labanotation using the ontology.

READ FULL TEXT

page 8

page 9

page 17

page 24

page 33

page 37

page 38

research
09/30/2020

Visual Semantic Multimedia Event Model for Complex Event Detection in Video Streams

Multimedia data is highly expressive and has traditionally been very dif...
research
09/24/2019

Posture and sequence recognition for Bharatanatyam dance performances using machine learning approach

Understanding the underlying semantics of performing arts like dance is ...
research
06/14/2022

Codec at SemEval-2022 Task 5: Multi-Modal Multi-Transformer Misogynous Meme Classification Framework

In this paper we describe our work towards building a generic framework ...
research
05/27/2014

A Topic Model Approach to Multi-Modal Similarity

Calculating similarities between objects defined by many heterogeneous d...
research
01/10/2014

STIMONT: A core ontology for multimedia stimuli description

Affective multimedia documents such as images, sounds or videos elicit e...
research
03/18/2021

Decomposing and Recomposing Event Structure

We present an event structure ontology empirically derived from inferent...

Please sign up or login with your details

Forgot password? Click here to reset