Support Relation Analysis for Objects in Multiple View RGB-D Images

05/10/2019
by   Peng Zhang, et al.
0

Understanding physical relations between objects, especially their support relations, is crucial for robotic manipulation. There has been work on reasoning about support relations and structural stability of simple configurations in RGB-D images. In this paper, we propose a method for extracting more detailed physical knowledge from a set of RGB-D images taken from the same scene but from different views using qualitative reasoning and intuitive physical models. Rather than providing a simple contact relation graph and approximating stability over convex shapes, our method is able to provide a detailed supporting relation analysis based on a volumetric representation. Specifically, true supporting relations between objects (e.g., if an object supports another object by touching it on the side or if the object above contributes to the stability of the object below) are identified. We apply our method to real-world structures captured in warehouse scenarios and show our method works as desired.

READ FULL TEXT

page 2

page 6

research
10/11/2017

Temporal and Physical Reasoning for Perception-Based Robotic Manipulation

Accurate knowledge of object poses is crucial to successful robotic mani...
research
09/19/2016

On Support Relations and Semantic Scene Graphs

Scene understanding is a popular and challenging topic in both computer ...
research
10/07/2020

Hierarchical Relational Inference

Common-sense physical reasoning in the real world requires learning abou...
research
05/02/2019

Improving Visual Relation Detection using Depth Maps

State of the art visual relation detection methods have been relying on ...
research
04/21/2018

ShapeStacks: Learning Vision-Based Physical Intuition for Generalised Object Stacking

Physical intuition is pivotal for intelligent agents to perform complex ...
research
08/01/2021

BORM: Bayesian Object Relation Model for Indoor Scene Recognition

Scene recognition is a fundamental task in robotic perception. For human...
research
10/05/2015

RAID: A Relation-Augmented Image Descriptor

As humans, we regularly interpret images based on the relations between ...

Please sign up or login with your details

Forgot password? Click here to reset