Relation Transformer Network

04/13/2020
by   Rajat Koner, et al.
1

The identification of objects in an image, together with their mutual relationships, can lead to a deep understanding of image content. Despite all the recent advances in deep learning, in particular, the detection and labeling of visual object relationships remain a challenging task. In this work, we present the Relation Transformer Network, which is a customized transformer-based architecture that models complex object to object and edge to object interactions, by taking into account global context. Our hierarchical multi-head attention-based approach efficiently models and predicts dependencies between objects and their contextual relationships. In comparison to another state of the art approaches, we achieve an absolute mean 3.72 improvement in performance on the Visual Genome dataset.

READ FULL TEXT

page 2

page 11

research
07/12/2021

Scenes and Surroundings: Scene Graph Generation using Relation Transformer

Identifying objects in an image and their mutual relationships as a scen...
research
09/11/2021

BGT-Net: Bidirectional GRU Transformer Network for Scene Graph Generation

Scene graphs are nodes and edges consisting of objects and object-object...
research
08/02/2021

GTNet:Guided Transformer Network for Detecting Human-Object Interactions

The human-object interaction (HOI) detection task refers to localizing h...
research
07/02/2021

Case Relation Transformer: A Crossmodal Language Generation Model for Fetching Instructions

There have been many studies in robotics to improve the communication sk...
research
04/11/2017

Detecting Visual Relationships with Deep Relational Networks

Relationships among objects play a crucial role in image understanding. ...
research
10/17/2022

A Saccaded Visual Transformer for General Object Spotting

This paper presents the novel combination of a visual transformer style ...
research
09/20/2022

Graph Reasoning Transformer for Image Parsing

Capturing the long-range dependencies has empirically proven to be effec...

Please sign up or login with your details

Forgot password? Click here to reset