VRED: A Position-Velocity Recurrent Encoder-Decoder for Human Motion Prediction

06/15/2019
by   Hongsong Wang, et al.
0

Human motion prediction, which aims to predict future human poses given past poses, has recently seen increased interest. Many recent approaches are based on Recurrent Neural Networks (RNN) which model human poses with exponential maps. These approaches neglect the pose velocity as well as temporal relation of different poses, and tend to converge to the mean pose or fail to generate natural-looking poses. We therefore propose a novel Position-Velocity Recurrent Encoder-Decoder (PVRED) for human motion prediction, which makes full use of pose velocities and temporal positional information. A temporal position embedding method is presented and a Position-Velocity RNN (PVRNN) is proposed. We also emphasize the benefits of quaternion parameterization of poses and design a novel trainable Quaternion Transformation (QT) layer, which is combined with a robust loss function during training. Experiments on two human motion prediction benchmarks show that our approach considerably outperforms the state-of-the-art methods for both short-term prediction and long-term prediction. In particular, our proposed approach can predict future human-like and meaningful poses in 4000 milliseconds.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/25/2020

AGVNet: Attention Guided Velocity Learning for 3D Human Motion Prediction

Human motion prediction plays a vital role in human-robot interaction wi...
research
07/13/2020

Multitask Non-Autoregressive Model for Human Motion Prediction

Human motion prediction, which aims at predicting future human skeletons...
research
08/02/2019

Learning Variations in Human Motion via Mix-and-Match Perturbation

Human motion prediction is a stochastic process: Given an observed seque...
research
04/01/2021

TrajeVAE – Controllable Human Motion Generation from Trajectories

The generation of plausible and controllable 3D human motion animations ...
research
06/08/2018

Unsupervised Learning for Surgical Motion by Learning to Predict the Future

We show that it is possible to learn meaningful representations of surgi...
research
05/06/2017

On human motion prediction using recurrent neural networks

Human motion modelling is a classical problem at the intersection of gra...
research
11/30/2020

Forecasting Characteristic 3D Poses of Human Actions

We propose the task of forecasting characteristic 3D poses: from a singl...

Please sign up or login with your details

Forgot password? Click here to reset