Long Term Motion Prediction Using Keyposes

12/08/2020
by   Sena Kiciroglu, et al.
0

Long term human motion prediction is an essential component in safety-critical applications, such as human-robot interaction and autonomous driving. We argue that, to achieve long term forecasting, predicting human pose at every time instant is unnecessary because human motion follows patterns that are well-represented by a few essential poses in the sequence. We call such poses "keyposes", and approximate complex motions by linearly interpolating between subsequent keyposes. We show that learning the sequence of such keyposes allows us to predict very long term motion, up to 5 seconds in the future. In particular, our predictions are much more realistic and better preserve the motion dynamics than those obtained by the state-of-the-art methods. Furthermore, our approach models the future keyposes probabilistically, which, during inference, lets us generate diverse future motions via sampling.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/12/2022

MultiAct: Long-Term 3D Human Motion Generation from Multiple Action Labels

We tackle the problem of generating long-term 3D human motion from multi...
research
12/01/2021

Dyadic Human Motion Prediction

Prior work on human motion forecasting has mostly focused on predicting ...
research
11/24/2017

Long-Term On-Board Prediction of People in Traffic Scenes under Uncertainty

Progress towards advanced systems for assisted and autonomous driving is...
research
05/19/2023

Remembering What Is Important: A Factorised Multi-Head Retrieval and Auxiliary Memory Stabilisation Scheme for Human Motion Prediction

Humans exhibit complex motions that vary depending on the task that they...
research
04/16/2019

Long-Term Video Generation of Multiple Futures Using Human Poses

Predicting the near-future from an input video is a useful task for appl...
research
04/16/2019

Long-Term Video Generation of Multiple FuturesUsing Human Poses

Predicting the near-future from an input video is a useful task for appl...
research
05/18/2020

Generative Tweening: Long-term Inbetweening of 3D Human Motions

The ability to generate complex and realistic human body animations at s...

Please sign up or login with your details

Forgot password? Click here to reset