On Support Relations and Semantic Scene Graphs

09/19/2016
by   Michael Ying Yang, et al.
1

Scene understanding is a popular and challenging topic in both computer vision and photogrammetry. Scene graph provides rich information for such scene understanding. This paper presents a novel approach to infer such relations and then to construct the scene graph. Support relations are estimated by considering important, previously ignored information: the physical stability and the prior support knowledge between object classes. In contrast to previous methods for extracting support relations, the proposed approach generates more accurate results, and does not require a pixel-wise semantic labeling of the scene. The semantic scene graph which describes all the contextual relations within the scene is constructed using this information. To evaluate the accuracy of these graphs, multiple different measures are formulated. The proposed algorithms are evaluated using the NYUv2 database. The results demonstrate that the inferred support relations are more precise than state-of-the-art. The scene graphs are compared against ground truth graphs.

READ FULL TEXT

page 2

page 3

page 4

page 6

page 7

page 10

page 12

research
01/14/2020

NODIS: Neural Ordinary Differential Scene Understanding

Semantic image understanding is a challenging topic in computer vision. ...
research
02/01/2020

Unbiased Scene Graph Generation via Rich and Fair Semantic Extraction

Extracting graph representation of visual scenes in image is a challengi...
research
08/20/2011

Toward Parts-Based Scene Understanding with Pixel-Support Parts-Sparse Pictorial Structures

Scene understanding remains a significant challenge in the computer visi...
research
05/10/2019

Support Relation Analysis for Objects in Multiple View RGB-D Images

Understanding physical relations between objects, especially their suppo...
research
03/20/2022

MetaOnce: A Metaverse Framework Based on Multi-scene Relations and Entity-relation-event Game

Existing metaverse systems lack rich relation types between entities and...
research
09/07/2022

VGStore: A Multimodal Extension to SPARQL for Querying RDF Scene Graph

Semantic Web technology has successfully facilitated many RDF models wit...
research
05/15/2023

Cross-Modality Time-Variant Relation Learning for Generating Dynamic Scene Graphs

Dynamic scene graphs generated from video clips could help enhance the s...

Please sign up or login with your details

Forgot password? Click here to reset