C·ASE: Learning Conditional Adversarial Skill Embeddings for Physics-based Characters

09/20/2023
by   Zhiyang Dou, et al.
0

We present C·ASE, an efficient and effective framework that learns conditional Adversarial Skill Embeddings for physics-based characters. Our physically simulated character can learn a diverse repertoire of skills while providing controllability in the form of direct manipulation of the skills to be performed. C·ASE divides the heterogeneous skill motions into distinct subsets containing homogeneous samples for training a low-level conditional model to learn conditional behavior distribution. The skill-conditioned imitation learning naturally offers explicit control over the character's skills after training. The training course incorporates the focal skill sampling, skeletal residual forces, and element-wise feature masking to balance diverse skills of varying complexities, mitigate dynamics mismatch to master agile motions and capture more general behavior characteristics, respectively. Once trained, the conditional model can produce highly diverse and realistic skills, outperforming state-of-the-art models, and can be repurposed in various downstream tasks. In particular, the explicit skill control handle allows a high-level policy or user to direct the character with desired skill specifications, which we demonstrate is advantageous for interactive character animation.

READ FULL TEXT

page 1

page 3

page 6

page 11

page 12

page 14

page 16

research
10/12/2022

ControlVAE: Model-Based Learning of Generative Controllers for Physics-Based Characters

In this paper, we introduce ControlVAE, a novel model-based framework fo...
research
01/31/2023

PADL: Language-Directed Physics-Based Character Control

Developing systems that can synthesize natural and life-like motions for...
research
05/02/2023

CALM: Conditional Adversarial Latent Models for Directable Virtual Characters

In this work, we present Conditional Adversarial Latent Models (CALM), a...
research
05/04/2022

ASE: Large-Scale Reusable Adversarial Skill Embeddings for Physically Simulated Characters

The incredible feats of athleticism demonstrated by humans are made poss...
research
07/28/2022

Learning Dynamic Manipulation Skills from Haptic-Play

In this paper, we propose a data-driven skill learning approach to solve...
research
05/05/2023

PMP: Learning to Physically Interact with Environments using Part-wise Motion Priors

We present a method to animate a character incorporating multiple part-w...
research
09/16/2022

Versatile Skill Control via Self-supervised Adversarial Imitation of Unlabeled Mixed Motions

Learning diverse skills is one of the main challenges in robotics. To th...

Please sign up or login with your details

Forgot password? Click here to reset