DeepAI AI Chat
Log In Sign Up

Exploring Versatile Prior for Human Motion via Motion Frequency Guidance

by   Jiachen Xu, et al.
SenseTime Corporation
Shanghai Jiao Tong University
East China Normal University

Prior plays an important role in providing the plausible constraint on human motion. Previous works design motion priors following a variety of paradigms under different circumstances, leading to the lack of versatility. In this paper, we first summarize the indispensable properties of the motion prior, and accordingly, design a framework to learn the versatile motion prior, which models the inherent probability distribution of human motions. Specifically, for efficient prior representation learning, we propose a global orientation normalization to remove redundant environment information in the original motion data space. Also, a two-level, sequence-based and segment-based, frequency guidance is introduced into the encoding stage. Then, we adopt a denoising training scheme to disentangle the environment information from input motion data in a learnable way, so as to generate consistent and distinguishable representation. Embedding our motion prior into prevailing backbones on three different tasks, we conduct extensive experiments, and both quantitative and qualitative results demonstrate the versatility and effectiveness of our motion prior. Our model and code are available at


page 1

page 8

page 13


Animation from Blur: Multi-modal Blur Decomposition with Motion Guidance

We study the challenging problem of recovering detailed motion from a si...

Weakly-supervised Action Transition Learning for Stochastic Human Motion Prediction

We introduce the task of action-driven stochastic human motion predictio...

Learning to Predict Diverse Human Motions from a Single Image via Mixture Density Networks

Human motion prediction, which plays a key role in computer vision, gene...

MotionAug: Augmentation with Physical Correction for Human Motion Prediction

This paper presents a motion data augmentation scheme incorporating moti...

HumanMAC: Masked Motion Completion for Human Motion Prediction

Human motion prediction is a classical problem in computer vision and co...

Freeform Body Motion Generation from Speech

People naturally conduct spontaneous body motions to enhance their speec...

Subgoal Planning Algorithm for Autonomous Vehicle Guidance

Trained humans exhibit highly agile spatial skills, enabling them to ope...

Code Repositories


Exploring Versatile Prior for Human Motion via Motion Frequency Guidance (3DV2021)

view repo