The Wanderings of Odysseus in 3D Scenes

12/16/2021
by   Yan Zhang, et al.
0

Our goal is to populate digital environments, in which the digital humans have diverse body shapes, move perpetually, and have plausible body-scene contact. The core challenge is to generate realistic, controllable, and infinitely long motions for diverse 3D bodies. To this end, we propose generative motion primitives via body surface markers, shortened as GAMMA. In our solution, we decompose the long-term motion into a time sequence of motion primitives. We exploit body surface markers and conditional variational autoencoder to model each motion primitive, and generate long-term motion by implementing the generative model recursively. To control the motion to reach a goal, we apply a policy network to explore the model latent space, and use a tree-based search to preserve the motion quality during testing. Experiments show that our method can produce more realistic and controllable motion than state-of-the-art data-driven method. With conventional path-finding algorithms, the generated human bodies can realistically move long distances for a long period of time in the scene. Code will be released for research purposes at: <https://yz-cnsdqz.github.io/eigenmotion/GAMMA/>

READ FULL TEXT

page 1

page 4

page 8

page 13

research
12/08/2022

MIME: Human-Aware 3D Scene Generation

Generating realistic 3D worlds occupied by moving humans has many applic...
research
02/01/2023

Correspondence-free online human motion retargeting

We present a novel data-driven framework for unsupervised human motion r...
research
04/25/2022

TEMOS: Generating diverse human motions from textual descriptions

We address the problem of generating diverse 3D human motions from textu...
research
07/04/2022

Learning Disentangled Representations for Controllable Human Motion Prediction

Generative model-based motion prediction techniques have recently realiz...
research
05/18/2020

Generative Tweening: Long-term Inbetweening of 3D Human Motions

The ability to generate complex and realistic human body animations at s...
research
09/25/2013

Contextually learnt detection of unusual motion-based behaviour in crowded public spaces

In this paper we are interested in analyzing behaviour in crowded public...
research
03/16/2023

Narrator: Towards Natural Control of Human-Scene Interaction Generation via Relationship Reasoning

Naturally controllable human-scene interaction (HSI) generation has an i...

Please sign up or login with your details

Forgot password? Click here to reset