Hierarchical Graph-Convolutional Variational AutoEncoding for Generative Modelling of Human Motion

11/24/2021
by   Anthony Bourached, et al.
0

Models of human motion commonly focus either on trajectory prediction or action classification but rarely both. The marked heterogeneity and intricate compositionality of human motion render each task vulnerable to the data degradation and distributional shift common to real-world scenarios. A sufficiently expressive generative model of action could in theory enable data conditioning and distributional resilience within a unified framework applicable to both tasks. Here we propose a novel architecture based on hierarchical variational autoencoders and deep graph convolutional neural networks for generating a holistic model of action over multiple time-scales. We show this Hierarchical Graph-convolutional Variational Autoencoder (HG-VAE) to be capable of generating coherent actions, detecting out-of-distribution data, and imputing missing data by gradient ascent on the model's posterior. Trained and evaluated on H3.6M and the largest collection of open source human motion data, AMASS, we show HG-VAE can facilitate downstream discriminative learning better than baseline models.

READ FULL TEXT
research
02/22/2023

Distributional Variational AutoEncoder To Infinite Quantiles and Beyond Gaussianity

The Gaussianity assumption has been pointed out as the main limitation o...
research
04/03/2020

Epitomic Variational Graph Autoencoder

Variational autoencoder (VAE) is a widely used generative model for unsu...
research
03/25/2021

GPRAR: Graph Convolutional Network based Pose Reconstruction and Action Recognition for Human Trajectory Prediction

Prediction with high accuracy is essential for various applications such...
research
08/12/2021

Conditional Temporal Variational AutoEncoder for Action Video Prediction

To synthesize a realistic action sequence based on a single human image,...
research
07/06/2018

A Variational Time Series Feature Extractor for Action Prediction

We propose a Variational Time Series Feature Extractor (VTSFE), inspired...
research
01/15/2023

T2M-GPT: Generating Human Motion from Textual Descriptions with Discrete Representations

In this work, we investigate a simple and must-known conditional generat...
research
07/01/2019

Bayesian Optimization on Large Graphs via a Graph Convolutional Generative Model: Application in Cardiac Model Personalization

Personalization of cardiac models involves the optimization of organ tis...

Please sign up or login with your details

Forgot password? Click here to reset