DeepAI AI Chat
Log In Sign Up

Exploring Versatile Prior for Human Motion via Motion Frequency Guidance

11/25/2021
by   Jiachen Xu, et al.
SenseTime Corporation
Shanghai Jiao Tong University
East China Normal University
0

Prior plays an important role in providing the plausible constraint on human motion. Previous works design motion priors following a variety of paradigms under different circumstances, leading to the lack of versatility. In this paper, we first summarize the indispensable properties of the motion prior, and accordingly, design a framework to learn the versatile motion prior, which models the inherent probability distribution of human motions. Specifically, for efficient prior representation learning, we propose a global orientation normalization to remove redundant environment information in the original motion data space. Also, a two-level, sequence-based and segment-based, frequency guidance is introduced into the encoding stage. Then, we adopt a denoising training scheme to disentangle the environment information from input motion data in a learnable way, so as to generate consistent and distinguishable representation. Embedding our motion prior into prevailing backbones on three different tasks, we conduct extensive experiments, and both quantitative and qualitative results demonstrate the versatility and effectiveness of our motion prior. Our model and code are available at https://github.com/JchenXu/human-motion-prior.

READ FULL TEXT

page 1

page 8

page 13

07/20/2022

Animation from Blur: Multi-modal Blur Decomposition with Motion Guidance

We study the challenging problem of recovering detailed motion from a si...
05/31/2022

Weakly-supervised Action Transition Learning for Stochastic Human Motion Prediction

We introduce the task of action-driven stochastic human motion predictio...
09/13/2021

Learning to Predict Diverse Human Motions from a Single Image via Mixture Density Networks

Human motion prediction, which plays a key role in computer vision, gene...
03/17/2022

MotionAug: Augmentation with Physical Correction for Human Motion Prediction

This paper presents a motion data augmentation scheme incorporating moti...
02/07/2023

HumanMAC: Masked Motion Completion for Human Motion Prediction

Human motion prediction is a classical problem in computer vision and co...
03/04/2022

Freeform Body Motion Generation from Speech

People naturally conduct spontaneous body motions to enhance their speec...
04/27/2020

Subgoal Planning Algorithm for Autonomous Vehicle Guidance

Trained humans exhibit highly agile spatial skills, enabling them to ope...

Code Repositories

human-motion-prior

Exploring Versatile Prior for Human Motion via Motion Frequency Guidance (3DV2021)


view repo