Generative Adversarial Graph Convolutional Networks for Human Action Synthesis

10/21/2021
by   Bruno Degardin, et al.
0

Synthesising the spatial and temporal dynamics of the human body skeleton remains a challenging task, not only in terms of the quality of the generated shapes, but also of their diversity, particularly to synthesise realistic body movements of a specific action (action conditioning). In this paper, we propose Kinetic-GAN, a novel architecture that leverages the benefits of Generative Adversarial Networks and Graph Convolutional Networks to synthesise the kinetics of the human body. The proposed adversarial architecture can condition up to 120 different actions over local and global body movements while improving sample quality and diversity through latent space disentanglement and stochastic variations. Our experiments were carried out in three well-known datasets, where Kinetic-GAN notably surpasses the state-of-the-art methods in terms of distribution quality metrics while having the ability to synthesise more than one order of magnitude regarding the number of different actions. Our code and models are publicly available at https://github.com/DegardinBruno/Kinetic-GAN.

READ FULL TEXT

page 1

page 2

page 5

page 6

page 8

page 9

page 10

research
05/14/2021

REGINA - Reasoning Graph Convolutional Networks in Human Action Recognition

It is known that the kinematics of the human body skeleton reveals valua...
research
11/22/2021

Generative Adversarial Networks for Astronomical Images Generation

Space exploration has always been a source of inspiration for humankind,...
research
11/17/2022

DeepPrivacy2: Towards Realistic Full-Body Anonymization

Generative Adversarial Networks (GANs) are widely adapted for anonymizat...
research
11/25/2022

BeLFusion: Latent Diffusion for Behavior-Driven Human Motion Prediction

Stochastic human motion prediction (HMP) has generally been tackled with...
research
09/07/2019

Graph Convolutional Networks for Temporal Action Localization

Most state-of-the-art action localization systems process each action pr...
research
06/20/2022

Generating Diverse Indoor Furniture Arrangements

We present a method for generating arrangements of indoor furniture from...
research
01/27/2018

Fast Cosmic Web Simulations with Generative Adversarial Networks

Dark matter in the universe evolves through gravity to form a complex ne...

Please sign up or login with your details

Forgot password? Click here to reset