Learning from the Scene and Borrowing from the Rich: Tackling the Long Tail in Scene Graph Generation

06/13/2020
by   Tao He, et al.
0

Despite the huge progress in scene graph generation in recent years, its long-tail distribution in object relationships remains a challenging and pestering issue. Existing methods largely rely on either external knowledge or statistical bias information to alleviate this problem. In this paper, we tackle this issue from another two aspects: (1) scene-object interaction aiming at learning specific knowledge from a scene via an additive attention mechanism; and (2) long-tail knowledge transfer which tries to transfer the rich knowledge learned from the head into the tail. Extensive experiments on the benchmark dataset Visual Genome on three tasks demonstrate that our method outperforms current state-of-the-art competitors.

READ FULL TEXT

page 3

page 6

research
03/08/2019

Knowledge-Embedded Routing Network for Scene Graph Generation

To understand a scene in depth not only involves locating/recognizing in...
research
10/03/2022

Unbiased Scene Graph Generation using Predicate Similarities

Scene Graphs are widely applied in computer vision as a graphical repres...
research
06/23/2022

Learning To Generate Scene Graph from Head to Tail

Scene Graph Generation (SGG) represents objects and their interactions w...
research
03/23/2023

Taking A Closer Look at Visual Relation: Unbiased Video Scene Graph Generation with Decoupled Label Learning

Current video-based scene graph generation (VidSGG) methods have been fo...
research
04/01/2019

Scene Graph Generation with External Knowledge and Image Reconstruction

Scene graph generation has received growing attention with the advanceme...
research
03/28/2023

HiLo: Exploiting High Low Frequency Relations for Unbiased Panoptic Scene Graph Generation

Panoptic Scene Graph generation (PSG) is a recently proposed task in ima...
research
12/31/2022

Peer Learning for Unbiased Scene Graph Generation

In this paper, we propose a novel framework dubbed peer learning to deal...

Please sign up or login with your details

Forgot password? Click here to reset