Generative Autoregressive Networks for 3D Dancing Move Synthesis from Music

11/11/2019
by   Hyemin Ahn, et al.
0

This paper proposes a framework which is able to generate a sequence of three-dimensional human dance poses for a given music. The proposed framework consists of three components: a music feature encoder, a pose generator, and a music genre classifier. We focus on integrating these components for generating a realistic 3D human dancing move from music, which can be applied to artificial agents and humanoid robots. The trained dance pose generator, which is a generative autoregressive model, is able to synthesize a dance sequence longer than 5,000 pose frames. Experimental results of generated dance sequences from various songs show how the proposed method generates human-like dancing move to a given music. In addition, a generated 3D dance sequence is applied to a humanoid robot, showing that the proposed framework can make a robot to dance just by listening to music.

READ FULL TEXT

page 1

page 8

research
09/17/2020

DanceIt: Music-inspired Dancing Video Synthesis

Close your eyes and listen to music, one can easily imagine an actor dan...
research
12/13/2019

Music-oriented Dance Video Synthesis with Pose Perceptual Loss

We present a learning-based approach with pose perceptual loss for autom...
research
08/18/2020

Generating Music with a Self-Correcting Non-Chronological Autoregressive Model

We describe a novel approach for generating music using a self-correctin...
research
12/28/2018

A Framework for Automated Pop-song Melody Generation with Piano Accompaniment Arrangement

We contribute a pop-song automation framework for lead melody generation...
research
06/01/2018

Semi-Recurrent CNN-based VAE-GAN for Sequential Data Generation

A semi-recurrent hybrid VAE-GAN model for generating sequential data is ...
research
09/12/2018

Neural Melody Composition from Lyrics

In this paper, we study a novel task that learns to compose music from n...
research
01/30/2023

DanceAnyWay: Synthesizing Mixed-Genre 3D Dance Movements Through Beat Disentanglement

We present DanceAnyWay, a hierarchical generative adversarial learning m...

Please sign up or login with your details

Forgot password? Click here to reset