Graph R-CNN for Scene Graph Generation

08/01/2018
by   Jianwei Yang, et al.
6

We propose a novel scene graph generation model called Graph R-CNN, that is both effective and efficient at detecting objects and their relations in images. Our model contains a Relation Proposal Network (RePN) that efficiently deals with the quadratic number of potential relations between objects in an image. We also propose an attentional Graph Convolutional Network (aGCN) that effectively captures contextual information between objects and relations. Finally, we introduce a new evaluation metric that is more holistic and realistic than existing metrics. We report state-of-the-art performance on scene graph generation as evaluated using both existing and our proposed metrics.

READ FULL TEXT
research
12/01/2022

Unbiased Heterogeneous Scene Graph Generation with Relation-aware Message Passing Neural Network

Recent scene graph generation (SGG) frameworks have focused on learning ...
research
07/30/2021

Enhancing Social Relation Inference with Concise Interaction Graph and Discriminative Scene Representation

There has been a recent surge of research interest in attacking the prob...
research
11/09/2020

Dual ResGCN for Balanced Scene GraphGeneration

Visual scene graph generation is a challenging task. Previous works have...
research
11/09/2018

Image-Level Attentional Context Modeling Using Nested-Graph Neural Networks

We introduce a new scene graph generation method called image-level atte...
research
07/17/2020

Sketching Image Gist: Human-Mimetic Hierarchical Scene Graph Generation

Scene graph aims to faithfully reveal humans' perception of image conten...
research
11/26/2021

Not All Relations are Equal: Mining Informative Labels for Scene Graph Generation

Scene graph generation (SGG) aims to capture a wide variety of interacti...
research
04/26/2023

Scene Graph Lossless Compression with Adaptive Prediction for Objects and Relations

The scene graph is a new data structure describing objects and their pai...

Please sign up or login with your details

Forgot password? Click here to reset