HOReeNet: 3D-aware Hand-Object Grasping Reenactment

11/11/2022
by   Changhwa Lee, et al.
0

We present HOReeNet, which tackles the novel task of manipulating images involving hands, objects, and their interactions. Especially, we are interested in transferring objects of source images to target images and manipulating 3D hand postures to tightly grasp the transferred objects. Furthermore, the manipulation needs to be reflected in the 2D image space. In our reenactment scenario involving hand-object interactions, 3D reconstruction becomes essential as 3D contact reasoning between hands and objects is required to achieve a tight grasp. At the same time, to obtain high-quality 2D images from 3D space, well-designed 3D-to-2D projection and image refinement are required. Our HOReeNet is the first fully differentiable framework proposed for such a task. On hand-object interaction datasets, we compared our HOReeNet to the conventional image translation algorithms and reenactment algorithm. We demonstrated that our approach could achieved the state-of-the-art on the proposed task.

READ FULL TEXT

page 1

page 2

page 4

research
11/24/2022

UV-Based 3D Hand-Object Reconstruction with Grasp Optimization

We propose a novel framework for 3D hand shape reconstruction and hand-o...
research
04/11/2019

Learning joint reconstruction of hands and manipulated objects

Estimating hand-object manipulations is essential for interpreting and i...
research
09/12/2017

Construction of Latent Descriptor Space and Inference Model of Hand-Object Interactions

Appearance-based generic object recognition is a challenging problem bec...
research
04/15/2019

ContactDB: Analyzing and Predicting Grasp Contact via Thermal Imaging

Grasping and manipulating objects is an important human skill. Since han...
research
05/16/2022

TOCH: Spatio-Temporal Object Correspondence to Hand for Motion Refinement

We present TOCH, a method for refining incorrect 3D hand-object interact...
research
12/18/2021

Multi-Object Grasping – Generating Efficient Robotic Picking and Transferring Policy

Transferring multiple objects between bins is a common task for many app...
research
02/22/2018

Driver Hand Localization and Grasp Analysis: A Vision-based Real-time Approach

Extracting hand regions and their grasp information from images robustly...

Please sign up or login with your details

Forgot password? Click here to reset