Imitation Learning for Human Pose Prediction

09/08/2019
by   Borui Wang, et al.
21

Modeling and prediction of human motion dynamics has long been a challenging problem in computer vision, and most existing methods rely on the end-to-end supervised training of various architectures of recurrent neural networks. Inspired by the recent success of deep reinforcement learning methods, in this paper we propose a new reinforcement learning formulation for the problem of human pose prediction, and develop an imitation learning algorithm for predicting future poses under this formulation through a combination of behavioral cloning and generative adversarial imitation learning. Our experiments show that our proposed method outperforms all existing state-of-the-art baseline models by large margins on the task of human pose prediction in both short-term predictions and long-term predictions, while also enjoying huge advantage in training speed.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/23/2018

Action-Agnostic Human Pose Forecasting

Predicting and forecasting human dynamics is a very interesting but chal...
research
05/08/2021

RAIL: A modular framework for Reinforcement-learning-based Adversarial Imitation Learning

While Adversarial Imitation Learning (AIL) algorithms have recently led ...
research
07/03/2019

Integration of Imitation Learning using GAIL and Reinforcement Learning using Task-achievement Rewards via Probabilistic Generative Model

Integration of reinforcement learning and imitation learning is an impor...
research
09/09/2023

AnyPose: Anytime 3D Human Pose Forecasting via Neural Ordinary Differential Equations

Anytime 3D human pose forecasting is crucial to synchronous real-world h...
research
09/23/2020

Pose Imitation Constraints for Collaborative Robots

Achieving human-like motion in robots has been a fundamental goal in man...
research
05/06/2017

On human motion prediction using recurrent neural networks

Human motion modelling is a classical problem at the intersection of gra...
research
03/16/2022

An Independently Learnable Hierarchical Model for Bilateral Control-Based Imitation Learning Applications

Recently, motion generation by machine learning has been actively resear...

Please sign up or login with your details

Forgot password? Click here to reset