Understanding and Exploiting Object Interaction Landscapes

by   Sören Pirk, et al.

Interactions play a key role in understanding objects and scenes, for both virtual and real world agents. We introduce a new general representation for proximal interactions among physical objects that is agnostic to the type of objects or interaction involved. The representation is based on tracking particles on one of the participating objects and then observing them with sensors appropriately placed in the interaction volume or on the interaction surfaces. We show how to factorize these interaction descriptors and project them into a particular participating object so as to obtain a new functional descriptor for that object, its interaction landscape, capturing its observed use in a spatio-temporal framework. Interaction landscapes are independent of the particular interaction and capture subtle dynamic effects in how objects move and behave when in functional use. Our method relates objects based on their function, establishes correspondences between shapes based on functional key points and regions, and retrieves peer and partner objects with respect to an interaction.


page 1

page 4

page 7

page 8

page 10

page 11


Construction of Latent Descriptor Space and Inference Model of Hand-Object Interactions

Appearance-based generic object recognition is a challenging problem bec...

Hand-Object Interaction Reasoning

This paper proposes an interaction reasoning network for modelling spati...

Measuring shape relations using r-parallel sets

Geometrical measurements of biological objects form the basis of many qu...

InterTracker: Discovering and Tracking General Objects Interacting with Hands in the Wild

Understanding human interaction with objects is an important research to...

Enforcing Topological Interaction between Implicit Surfaces via Uniform Sampling

Objects interact with each other in various ways, including containment,...

InterDiff: Generating 3D Human-Object Interactions with Physics-Informed Diffusion

This paper addresses a novel task of anticipating 3D human-object intera...

Please sign up or login with your details

Forgot password? Click here to reset