Adversarial Attention for Human Motion Synthesis

04/25/2022
by   Matthew Malek-Podjaski, et al.
0

Analysing human motions is a core topic of interest for many disciplines, from Human-Computer Interaction, to entertainment, Virtual Reality and healthcare. Deep learning has achieved impressive results in capturing human pose in real-time. On the other hand, due to high inter-subject variability, human motion analysis models often suffer from not being able to generalise to data from unseen subjects due to very limited specialised datasets available in fields such as healthcare. However, acquiring human motion datasets is highly time-consuming, challenging, and expensive. Hence, human motion synthesis is a crucial research problem within deep learning and computer vision. We present a novel method for controllable human motion synthesis by applying attention-based probabilistic deep adversarial models with end-to-end training. We show that we can generate synthetic human motion over both short- and long-time horizons through the use of adversarial attention. Furthermore, we show that we can improve the classification performance of deep learning models in cases where there is inadequate real data, by supplementing existing datasets with synthetic motions.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/21/2018

Combining Recurrent Neural Networks and Adversarial Training for Human Motion Synthesis and Control

This paper introduces a new generative deep learning network for human m...
research
01/07/2022

A Review of Deep Learning Techniques for Markerless Human Motion on Synthetic Datasets

Markerless motion capture has become an active field of research in comp...
research
04/05/2019

AMASS: Archive of Motion Capture as Surface Shapes

Large datasets are the cornerstone of recent advances in computer vision...
research
10/09/2022

Computational Choreography using Human Motion Synthesis

Should deep learning models be trained to analyze human performance art?...
research
10/01/2021

GAN-based Reactive Motion Synthesis with Class-aware Discriminators for Human-human Interaction

Creating realistic characters that can react to the users' or another ch...
research
09/27/2020

Recognition and Synthesis of Object Transport Motion

Deep learning typically requires vast numbers of training examples in or...
research
05/16/2019

MoGlow: Probabilistic and controllable motion synthesis using normalising flows

Data-driven modelling and synthesis of motion data is an active research...

Please sign up or login with your details

Forgot password? Click here to reset