QuaterNet: A Quaternion-based Recurrent Model for Human Motion

05/16/2018
by   Dario Pavllo, et al.
0

Deep learning for predicting or generating 3D human pose sequences is an active research area. Previous work regresses either joint rotations or joint positions. The former strategy is prone to error accumulation along the kinematic chain, as well as discontinuities when using Euler angle or exponential map parameterizations. The latter requires re-projection onto skeleton constraints to avoid bone stretching and invalid configurations. This work addresses both limitations. Our recurrent network, QuaterNet, represents rotations with quaternions and our loss function performs forward kinematics on a skeleton to penalize absolute position errors instead of angle errors. On short-term predictions, QuaterNet improves the state-of-the-art quantitatively. For long-term generation, our approach is qualitatively judged as realistic as recent neural strategies from the graphics literature.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/21/2019

Modeling Human Motion with Quaternion-based Neural Networks

Previous work on predicting or generating 3D human pose sequences regres...
research
07/26/2022

KinePose: A temporally optimized inverse kinematics technique for 6DOF human pose estimation with biomechanical constraints

Computer vision/deep learning-based 3D human pose estimation methods aim...
research
10/23/2018

Action-Agnostic Human Pose Forecasting

Predicting and forecasting human dynamics is a very interesting but chal...
research
10/20/2019

Structured Prediction Helps 3D Human Motion Modelling

Human motion prediction is a challenging and important task in many comp...
research
02/22/2020

Back to the Future: Joint Aware Temporal Deep Learning 3D Human Pose Estimation

We propose a new deep learning network that introduces a deeper CNN chan...
research
06/22/2020

MotioNet: 3D Human Motion Reconstruction from Monocular Video with Skeleton Consistency

We introduce MotioNet, a deep neural network that directly reconstructs ...

Please sign up or login with your details

Forgot password? Click here to reset