Placing Human Animations into 3D Scenes by Learning Interaction- and Geometry-Driven Keyframes

09/13/2022
by   James F. Mullen Jr, et al.
4

We present a novel method for placing a 3D human animation into a 3D scene while maintaining any human-scene interactions in the animation. We use the notion of computing the most important meshes in the animation for the interaction with the scene, which we call "keyframes." These keyframes allow us to better optimize the placement of the animation into the scene such that interactions in the animations (standing, laying, sitting, etc.) match the affordances of the scene (e.g., standing on the floor or laying in a bed). We compare our method, which we call PAAK, with prior approaches, including POSA, PROX ground truth, and a motion synthesis method, and highlight the benefits of our method with a perceptual study. Human raters preferred our PAAK method over the PROX ground truth data 64.6% of the time. Additionally, in direct comparisons, the raters preferred PAAK over competing methods including 61.5% compared to POSA.

READ FULL TEXT

page 1

page 3

page 5

page 7

page 8

research
03/24/2023

PACE: Data-Driven Virtual Agent Interaction in Dense and Cluttered Environments

We present PACE, a novel method for modifying motion-captured virtual ag...
research
12/14/2021

EgoBody: Human Body Shape, Motion and Social Interactions from Head-Mounted Devices

Understanding social interactions from first-person views is crucial for...
research
08/30/2018

Automated Scene Flow Data Generation for Training and Verification

Scene flow describes the 3D position as well as the 3D motion of each pi...
research
06/15/2023

Generative Proxemics: A Prior for 3D Social Interaction from Images

Social interaction is a fundamental aspect of human behavior and communi...
research
12/03/2018

What can I do here? Leveraging Deep 3D saliency and geometry for fast and scalable multiple affordance detection

This paper develops and evaluates a novel method that allows for the det...
research
03/31/2023

CIMI4D: A Large Multimodal Climbing Motion Dataset under Human-scene Interactions

Motion capture is a long-standing research problem. Although it has been...
research
04/25/2019

Meta-Sim: Learning to Generate Synthetic Datasets

Training models to high-end performance requires availability of large l...

Please sign up or login with your details

Forgot password? Click here to reset