Construction of Latent Descriptor Space and Inference Model of Hand-Object Interactions

09/12/2017
by   Tadashi Matsuo, et al.
0

Appearance-based generic object recognition is a challenging problem because all possible appearances of objects cannot be registered, especially as new objects are produced every day. Function of objects, however, has a comparatively small number of prototypes. Therefore, function-based classification of new objects could be a valuable tool for generic object recognition. Object functions are closely related to hand-object interactions during handling of a functional object; i.e., how the hand approaches the object, which parts of the object and contact the hand, and the shape of the hand during interaction. Hand-object interactions are helpful for modeling object functions. However, it is difficult to assign discrete labels to interactions because an object shape and grasping hand-postures intrinsically have continuous variations. To describe these interactions, we propose the interaction descriptor space which is acquired from unlabeled appearances of human hand-object interactions. By using interaction descriptors, we can numerically describe the relation between an object's appearance and its possible interaction with the hand. The model infers the quantitative state of the interaction from the object image alone. It also identifies the parts of objects designed for hand interactions such as grips and handles. We demonstrate that the proposed method can unsupervisedly generate interaction descriptors that make clusters corresponding to interaction types. And also we demonstrate that the model can infer possible hand-object interactions.

READ FULL TEXT

page 3

page 6

page 8

page 9

page 10

research
11/11/2022

HOReeNet: 3D-aware Hand-Object Grasping Reenactment

We present HOReeNet, which tackles the novel task of manipulating images...
research
09/27/2016

Understanding and Exploiting Object Interaction Landscapes

Interactions play a key role in understanding objects and scenes, for bo...
research
08/10/2020

Measuring shape relations using r-parallel sets

Geometrical measurements of biological objects form the basis of many qu...
research
03/08/2016

Hand Segmentation for Hand-Object Interaction from Depth map

Hand-object interaction is important for many applications such as augme...
research
06/14/2013

Matching objects across the textured-smooth continuum

The problem of 3D object recognition is of immense practical importance,...
research
05/01/2013

An Adaptive Descriptor Design for Object Recognition in the Wild

Digital images nowadays have various styles of appearance, in the aspect...
research
07/16/2023

Enforcing Topological Interaction between Implicit Surfaces via Uniform Sampling

Objects interact with each other in various ways, including containment,...

Please sign up or login with your details

Forgot password? Click here to reset