Free-body Gesture Tracking and Augmented Reality Improvisation for Floor and Aerial Dance

by   Tammuz Dubnov, et al.

This paper describes an updated interactive performance system for floor and Aerial Dance that controls visual and sonic aspects of the presentation via a depth sensing camera (MS Kinect). In order to detect, measure and track free movement in space, 3 degree of freedom (3-DOF) tracking in space (on the ground and in the air) is performed using IR markers with a method for multi target tracking capabilities added and described in detail. An improved gesture tracking and recognition system, called Action Graph (AG), is described in the paper. Action Graph uses an efficient incremental construction from a single long sequence of movement features and automatically captures repeated sub-segments in the movement from start to finish with no manual interaction needed with other advanced capabilities discussed as well. By using the new model for the gesture we can unify an entire choreography piece by dynamically tracking and recognizing gestures and sub-portions of the piece. This gives the performer the freedom to improvise based on a set of recorded gestures/portions of the choreography and have the system dynamically respond in relation to the performer within a set of related rehearsed actions, an ability that has not been seen in any other system to date.


Automated Training and Maintenance through Kinect

In this paper, we have worked on reducing burden on mechanic involving c...

Eliciting Multimodal Gesture+Speech Interactions in a Multi-Object Augmented Reality Environment

As augmented reality technology and hardware become more mature and affo...

GestureMap: Supporting Visual Analytics and Quantitative Analysis of Motion Elicitation Data by Learning 2D Embeddings

This paper presents GestureMap, a visual analytics tool for gesture elic...

How Do Users Interact with an Error-Prone In-Air Gesture Recognizer?

We present results of two pilot studies that investigated human error be...

GestureLens: Visual Analysis of Gestures in Presentation Videos

Appropriate gestures can enhance message delivery and audience engagemen...

Quantitative analysis of robot gesticulation behavior

Social robot capabilities, such as talking gestures, are best produced u...

Gesture Recognition with a Focus on Important Actions by Using a Path Searching Method in Weighted Graph

This paper proposes a method of gesture recognition with a focus on impo...

Please sign up or login with your details

Forgot password? Click here to reset