Weakly Supervised Deep Recurrent Neural Networks for Basic Dance Step Generation

07/03/2018
by   Nelson Yalta, et al.
0

A deep recurrent neural network with audio input is applied to model basic dance steps. The proposed model employs multilayered Long Short-Term Memory (LSTM) layers and convolutional layers to process the audio power spectrum. Then, another deep LSTM layer decodes the target dance sequence. This end-to-end approach has an auto-conditioned decode configuration that reduces accumulation of feedback error. Experimental results demonstrate that, after training using a small dataset, the model generates basic dance steps with low cross entropy and maintains a motion beat F-measure score similar to that of a baseline dancer. In addition, we investigate the use of a contrastive cost function for music-motion regulation. This cost function targets motion direction and maps similarities between music frames. Experimental result demonstrate that the cost function improves the motion beat f-score.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/10/2014

Bach in 2014: Music Composition with Recurrent Neural Network

We propose a framework for computer music composition that uses resilien...
research
11/12/2016

Multi-Language Identification Using Convolutional Recurrent Neural Network

Language Identification, being an important aspect of Automatic Speaker ...
research
03/23/2022

Music Generation Using an LSTM

Over the past several years, deep learning for sequence modeling has gro...
research
03/20/2017

Dance Dance Convolution

Dance Dance Revolution (DDR) is a popular rhythm-based video game. Playe...
research
05/05/2017

Max-Pooling Loss Training of Long Short-Term Memory Networks for Small-Footprint Keyword Spotting

We propose a max-pooling based loss function for training Long Short-Ter...
research
10/26/2019

A holistic approach to polyphonic music transcription with neural networks

We present a framework based on neural networks to extract music scores ...
research
06/10/2017

Direct detection of pixel-level myocardial infarction areas via a deep-learning algorithm

Accurate detection of the myocardial infarction (MI) area is crucial for...

Please sign up or login with your details

Forgot password? Click here to reset