Generating Smooth Pose Sequences for Diverse Human Motion Prediction

08/19/2021
by   Wei Mao, et al.
0

Recent progress in stochastic motion prediction, i.e., predicting multiple possible future human motions given a single past pose sequence, has led to producing truly diverse future motions and even providing control over the motion of some body parts. However, to achieve this, the state-of-the-art method requires learning several mappings for diversity and a dedicated model for controllable motion prediction. In this paper, we introduce a unified deep generative network for both diverse and controllable motion prediction. To this end, we leverage the intuition that realistic human motions consist of smooth sequences of valid poses, and that, given limited data, learning a pose prior is much more tractable than a motion one. We therefore design a generator that predicts the motion of different body parts sequentially, and introduce a normalizing flow based pose prior, together with a joint angle loss, to achieve motion realism.Our experiments on two standard benchmark datasets, Human3.6M and HumanEva-I, demonstrate that our approach outperforms the state-of-the-art baselines in terms of both sample diversity and accuracy. The code is available at https://github.com/wei-mao-2019/gsps

READ FULL TEXT

page 11

page 13

research
09/13/2022

DMMGAN: Diverse Multi Motion Prediction of 3D Human Joints using Attention-Based Generative Adverserial Network

Human motion prediction is a fundamental part of many human-robot applic...
research
09/13/2021

Learning to Predict Diverse Human Motions from a Single Image via Mixture Density Networks

Human motion prediction, which plays a key role in computer vision, gene...
research
02/09/2023

Diverse Human Motion Prediction Guided by Multi-Level Spatial-Temporal Anchors

Predicting diverse human motions given a sequence of historical poses ha...
research
07/15/2022

Diverse Human Motion Prediction via Gumbel-Softmax Sampling from an Auxiliary Space

Diverse human motion prediction aims at predicting multiple possible fut...
research
02/09/2022

Conditional Motion In-betweening

Motion in-betweening (MIB) is a process of generating intermediate skele...
research
07/04/2022

Learning Disentangled Representations for Controllable Human Motion Prediction

Generative model-based motion prediction techniques have recently realiz...
research
12/01/2020

We are More than Our Joints: Predicting how 3D Bodies Move

A key step towards understanding human behavior is the prediction of 3D ...

Please sign up or login with your details

Forgot password? Click here to reset