HR-RCNN: Hierarchical Relational Reasoning for Object Detection

10/26/2021
by   Hao Chen, et al.
0

Incorporating relational reasoning in neural networks for object recognition remains an open problem. Although many attempts have been made for relational reasoning, they generally only consider a single type of relationship. For example, pixel relations through self-attention (e.g., non-local networks), scale relations through feature fusion (e.g., feature pyramid networks), or object relations through graph convolutions (e.g., reasoning-RCNN). Little attention has been given to more generalized frameworks that can reason across these relationships. In this paper, we propose a hierarchical relational reasoning framework (HR-RCNN) for object detection, which utilizes a novel graph attention module (GAM). This GAM is a concise module that enables reasoning across heterogeneous nodes by operating on the graph edges directly. Leveraging heterogeneous relationships, our HR-RCNN shows great improvement on COCO dataset, for both object detection and instance segmentation.

READ FULL TEXT

page 1

page 2

research
11/01/2018

Dilated DenseNets for Relational Reasoning

Despite their impressive performance in many tasks, deep neural networks...
research
11/29/2018

Efficient Coarse-to-Fine Non-Local Module for the Detection of Small Objects

An image is not just a collection of objects, but rather a graph where e...
research
03/29/2018

Iterative Visual Reasoning Beyond Convolutions

We present a novel framework for iterative visual reasoning. Our framewo...
research
09/10/2020

RVL-BERT: Visual Relationship Detection with Visual-Linguistic Knowledge from Pre-trained Representations

Visual relationship detection aims to reason over relationships among sa...
research
02/26/2022

Analysis of Visual Reasoning on One-Stage Object Detection

Current state-of-the-art one-stage object detectors are limited by treat...
research
06/06/2022

Relation Matters: Foreground-aware Graph-based Relational Reasoning for Domain Adaptive Object Detection

Domain Adaptive Object Detection (DAOD) focuses on improving the general...
research
06/06/2019

3D-RelNet: Joint Object and Relational Network for 3D Prediction

We propose an approach to predict the 3D shape and pose for the objects ...

Please sign up or login with your details

Forgot password? Click here to reset