DeepAI AI Chat
Log In Sign Up

Graph-based Normalizing Flow for Human Motion Generation and Reconstruction

by   Wenjie Yin, et al.

Data-driven approaches for modeling human skeletal motion have found various applications in interactive media and social robotics. Challenges remain in these fields for generating high-fidelity samples and robustly reconstructing motion from imperfect input data, due to e.g. missed marker detection. In this paper, we propose a probabilistic generative model to synthesize and reconstruct long horizon motion sequences conditioned on past information and control signals, such as the path along which an individual is moving. Our method adapts the existing work MoGlow by introducing a new graph-based model. The model leverages the spatial-temporal graph convolutional network (ST-GCN) to effectively capture the spatial structure and temporal correlation of skeletal motion data at multiple scales. We evaluate the models on a mixture of motion capture datasets of human locomotion with foot-step and bone-length analysis. The results demonstrate the advantages of our model in reconstructing missing markers and achieving comparable results on generating realistic future poses. When the inputs are imperfect, our model shows improvements on robustness of generation.


page 1

page 2

page 3

page 4


Graph-Based Spatial-Temporal Convolutional Network for Vehicle Trajectory Prediction in Autonomous Driving

Forecasting the trajectories of neighbor vehicles is a crucial step for ...

Spatial-Temporal Gating-Adjacency GCN for Human Motion Prediction

Predicting future motion based on historical motion sequence is a fundam...

Skeleton-Based Action Segmentation with Multi-Stage Spatial-Temporal Graph Convolutional Neural Networks

The ability to identify and temporally segment fine-grained actions in m...

Towards 3D Dance Motion Synthesis and Control

3D human dance motion is a cooperative and elegant social movement. Unli...

History Repeats Itself: Human Motion Prediction via Motion Attention

Human motion prediction aims to forecast future human poses given a past...

Multi-frame sequence generator of 4D human body motion

We examine the problem of generating temporally and spatially dense 4D h...

MoGlow: Probabilistic and controllable motion synthesis using normalising flows

Data-driven modelling and synthesis of motion data is an active research...