Action2Motion: Conditioned Generation of 3D Human Motions

07/30/2020
by   Chuan Guo, et al.
9

Action recognition is a relatively established task, where givenan input sequence of human motion, the goal is to predict its ac-tion category. This paper, on the other hand, considers a relativelynew problem, which could be thought of as an inverse of actionrecognition: given a prescribed action type, we aim to generateplausible human motion sequences in 3D. Importantly, the set ofgenerated motions are expected to maintain itsdiversityto be ableto explore the entire action-conditioned motion space; meanwhile,each sampled sequence faithfully resembles anaturalhuman bodyarticulation dynamics. Motivated by these objectives, we followthe physics law of human kinematics by adopting the Lie Algebratheory to represent thenaturalhuman motions; we also propose atemporal Variational Auto-Encoder (VAE) that encourages adiversesampling of the motion space. A new 3D human motion dataset, HumanAct12, is also constructed. Empirical experiments overthree distinct human motion datasets (including ours) demonstratethe effectiveness of our approach.

READ FULL TEXT
research
04/12/2021

Action-Conditioned 3D Human Motion Synthesis with Transformer VAE

We tackle the problem of action-conditioned generation of realistic and ...
research
11/12/2021

Action2video: Generating Videos of Human 3D Actions

We aim to tackle the interesting yet challenging problem of generating v...
research
03/25/2022

Implicit Neural Representations for Variable Length Human Motion Generation

We propose an action-conditional human motion generation method using va...
research
07/17/2022

Action-conditioned On-demand Motion Generation

We propose a novel framework, On-Demand MOtion Generation (ODMO), for ge...
research
10/05/2020

Deep Generative Modelling of Human Reach-and-Place Action

The motion of picking up and placing an object in 3D space is full of su...
research
06/12/2023

4DHumanOutfit: a multi-subject 4D dataset of human motion sequences in varying outfits exhibiting large displacements

This work presents 4DHumanOutfit, a new dataset of densely sampled spati...
research
10/19/2022

PoseGPT: Quantization-based 3D Human Motion Generation and Forecasting

We address the problem of action-conditioned generation of human motion ...

Please sign up or login with your details

Forgot password? Click here to reset