Character Controllers Using Motion VAEs

03/26/2021
by   Hung Yu Ling, et al.
0

A fundamental problem in computer animation is that of realizing purposeful and realistic human movement given a sufficiently-rich set of motion capture clips. We learn data-driven generative models of human movement using autoregressive conditional variational autoencoders, or Motion VAEs. The latent variables of the learned autoencoder define the action space for the movement and thereby govern its evolution over time. Planning or control algorithms can then use this action space to generate desired motions. In particular, we use deep reinforcement learning to learn controllers that achieve goal-directed movements. We demonstrate the effectiveness of the approach on multiple tasks. We further evaluate system-design choices and describe the current limitations of Motion VAEs.

READ FULL TEXT

page 1

page 5

research
10/08/2018

SFV: Reinforcement Learning of Physical Skills from Videos

Data-driven character animation based on motion capture can produce high...
research
03/02/2022

Imitation and Adaptation Based on Consistency: A Quadruped Robot Imitates Animals from Videos Using Deep Reinforcement Learning

The essence of quadrupeds' movements is the movement of the center of gr...
research
05/02/2023

CALM: Conditional Adversarial Latent Models for Directable Virtual Characters

In this work, we present Conditional Adversarial Latent Models (CALM), a...
research
10/20/2020

Probabilistic Character Motion Synthesis using a Hierarchical Deep Latent Variable Model

We present a probabilistic framework to generate character animations ba...
research
04/30/2019

Synthesis of Biologically Realistic Human Motion Using Joint Torque Actuation

Using joint actuators to drive the skeletal movements is a common practi...
research
12/03/2020

Recovering Trajectories of Unmarked Joints in 3D Human Actions Using Latent Space Optimization

Motion capture (mocap) and time-of-flight based sensing of human actions...
research
07/05/2021

Using Probabilistic Movement Primitives in Analyzing Human Motion Difference under Transcranial Current Stimulation

In medical tasks such as human motion analysis, computer-aided auxiliary...

Please sign up or login with your details

Forgot password? Click here to reset