Implicit Neural Representations for Variable Length Human Motion Generation

03/25/2022
by   Pablo Cervantes, et al.
0

We propose an action-conditional human motion generation method using variational implicit neural representations (INR). The variational formalism enables action-conditional distributions of INRs, from which one can easily sample representations to generate novel human motion sequences. Our method offers variable-length sequence generation by construction because a part of INR is optimized for a whole sequence of arbitrary length with temporal embeddings. In contrast, previous works reported difficulties with modeling variable-length sequences. We confirm that our method with a Transformer decoder outperforms all relevant methods on HumanAct12, NTU-RGBD, and UESTC datasets in terms of realism and diversity of generated motions. Surprisingly, even our method with an MLP decoder consistently outperforms the state-of-the-art Transformer-based auto-encoder. In particular, we show that variable-length motions generated by our method are better than fixed-length motions generated by the state-of-the-art method in terms of realism and diversity.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/12/2021

Diversity-Promoting Human Motion Interpolation via Conditional Variational Auto-Encoder

In this paper, we present a deep generative model based method to genera...
research
07/30/2020

Action2Motion: Conditioned Generation of 3D Human Motions

Action recognition is a relatively established task, where givenan input...
research
09/09/2009

Motion Segmentation by SCC on the Hopkins 155 Database

We apply the Spectral Curvature Clustering (SCC) algorithm to a benchmar...
research
06/14/2022

Recurrent Transformer Variational Autoencoders for Multi-Action Motion Synthesis

We consider the problem of synthesizing multi-action human motion sequen...
research
10/21/2021

MUGL: Large Scale Multi Person Conditional Action Generation with Locomotion

We introduce MUGL, a novel deep neural model for large-scale, diverse ge...
research
11/12/2021

Action2video: Generating Videos of Human 3D Actions

We aim to tackle the interesting yet challenging problem of generating v...
research
11/29/2022

UDE: A Unified Driving Engine for Human Motion Generation

Generating controllable and editable human motion sequences is a key cha...

Please sign up or login with your details

Forgot password? Click here to reset