Table-Top Scene Analysis Using Knowledge-Supervised MCMC

02/19/2020
by   Ziyuan Liu, et al.
1

In this paper, we propose a probabilistic method to generate abstract scene graphs for table-top scenes from 6D object pose estimates. We explicitly make use of task-specfic context knowledge by encoding this knowledge as descriptive rules in Markov logic networks. Our approach to generate scene graphs is probabilistic: Uncertainty in the object poses is addressed by a probabilistic sensor model that is embedded in a data driven MCMC process. We apply Markov logic inference to reason about hidden objects and to detect false estimates of object poses. The effectiveness of our approach is demonstrated and evaluated in real world experiments.

READ FULL TEXT

page 3

page 10

page 13

page 14

page 15

research
02/19/2020

A Generalizable Knowledge Framework for Semantic Indoor Mapping Based on Markov Logic Networks and Data Driven MCMC

In this paper, we propose a generalizable knowledge framework for data a...
research
10/30/2021

3DP3: 3D Scene Perception via Probabilistic Programming

We present 3DP3, a framework for inverse graphics that uses inference in...
research
02/21/2020

Applying Rule-Based Context Knowledge to Build Abstract Semantic Maps of Indoor Environments

In this paper, we propose a generalizable method that systematically com...
research
03/08/2019

Auto-Encoding Progressive Generative Adversarial Networks For 3D Multi Object Scenes

3D multi object generative models allow us to synthesize a large range o...
research
10/27/2018

Flash Photography for Data-Driven Hidden Scene Recovery

Vehicles, search and rescue personnel, and endoscopes use flash lights t...
research
10/08/2019

Refining 6D Object Pose Predictions using Abstract Render-and-Compare

Robotic systems often require precise scene analysis capabilities, espec...
research
01/13/2020

NimbRo Logistics – Project KittingBot

Recovering the pose of an object from mere point clouds is often hindere...

Please sign up or login with your details

Forgot password? Click here to reset