COUCH: Towards Controllable Human-Chair Interactions

05/01/2022
by   Xiaohan Zhang, et al.
0

Humans interact with an object in many different ways by making contact at different locations, creating a highly complex motion space that can be difficult to learn, particularly when synthesizing such human interactions in a controllable manner. Existing works on synthesizing human scene interaction focus on the high-level control of action but do not consider the fine-grained control of motion. In this work, we study the problem of synthesizing scene interactions conditioned on different contact positions on the object. As a testbed to investigate this new problem, we focus on human-chair interaction as one of the most common actions which exhibit large variability in terms of contacts. We propose a novel synthesis framework COUCH that plans ahead the motion by predicting contact-aware control signals of the hands, which are then used to synthesize contact-conditioned interactions. Furthermore, we contribute a large human-chair interaction dataset with clean annotations, the COUCH Dataset. Our method shows significant quantitative and qualitative improvements over existing methods for human-object interactions. More importantly, our method enables control of the motion through user-specified or automatically predicted contacts.

READ FULL TEXT

page 1

page 5

page 11

page 14

research
07/26/2022

Compositional Human-Scene Interaction Synthesis with Semantic Control

Synthesizing natural interactions between virtual humans and their 3D en...
research
05/24/2023

Interactive Neural Resonators

In this work, we propose a method for the controllable synthesis of real...
research
07/07/2020

Long-term Human Motion Prediction with Scene Context

Human movement is goal-directed and influenced by the spatial layout of ...
research
09/14/2023

Unified Human-Scene Interaction via Prompted Chain-of-Contacts

Human-Scene Interaction (HSI) is a vital component of fields like embodi...
research
12/14/2022

IMos: Intent-Driven Full-Body Motion Synthesis for Human-Object Interactions

Can we make virtual characters in a scene interact with their surroundin...
research
03/03/2023

Multi-Scale Control Signal-Aware Transformer for Motion Synthesis without Phase

Synthesizing controllable motion for a character using deep learning has...
research
10/08/2022

Contact-aware Human Motion Forecasting

In this paper, we tackle the task of scene-aware 3D human motion forecas...

Please sign up or login with your details

Forgot password? Click here to reset