Low-Cost Scene Modeling using a Density Function Improves Segmentation Performance

05/26/2016
by   Vivek Sharma, et al.
0

We propose a low cost and effective way to combine a free simulation software and free CAD models for modeling human-object interaction in order to improve human & object segmentation. It is intended for research scenarios related to safe human-robot collaboration (SHRC) and interaction (SHRI) in the industrial domain. The task of human and object modeling has been used for detecting activity, and for inferring and predicting actions, different from those works, we do human and object modeling in order to learn interactions in RGB-D data for improving segmentation. For this purpose, we define a novel density function to model a three dimensional (3D) scene in a virtual environment (VREP). This density function takes into account various possible configurations of human-object and object-object relationships and interactions governed by their affordances. Using this function, we synthesize a large, realistic and highly varied synthetic RGB-D dataset that we use for training. We train a random forest classifier, and the pixelwise predictions obtained is integrated as a unary term in a pairwise conditional random fields (CRF). Our evaluation shows that modeling these interactions improves segmentation performance by 7% in mean average precision and recall over state-of-the-art methods that ignore these interactions in real-world data. Our approach is computationally efficient, robust and can run real-time on consumer hardware.

READ FULL TEXT

page 3

page 4

page 5

research
11/16/2017

Attend and Interact: Higher-Order Object Interactions for Video Understanding

Human actions often involve complex interactions across several inter-re...
research
03/01/2017

Learning Social Affordance Grammar from Videos: Transferring Human Interactions to Human-Robot Interactions

In this paper, we present a general framework for learning social afford...
research
11/20/2018

Scene Graph Generation via Conditional Random Fields

Despite the great success object detection and segmentation models have ...
research
01/07/2022

Detecting Human-to-Human-or-Object (H2O) Interactions with DIABOLO

Detecting human interactions is crucial for human behavior analysis. Man...
research
10/08/2019

Object-centric Forward Modeling for Model Predictive Control

We present an approach to learn an object-centric forward model, and sho...
research
05/22/2023

An Abstract Specification of VoxML as an Annotation Language

VoxML is a modeling language used to map natural language expressions in...

Please sign up or login with your details

Forgot password? Click here to reset