Should I Look at the Head or the Tail? Dual-awareness Attention for Few-Shot Object Detection

02/24/2021
by   Tung-I Chen, et al.
2

While recent progress has significantly boosted few-shot classification (FSC) performance, few-shot object detection (FSOD) remains challenging for modern learning systems. Existing FSOD systems follow FSC approaches, neglect the problem of spatial misalignment and the risk of information entanglement, and result in low performance. Observing this, we propose a novel Dual-Awareness-Attention (DAnA), which captures the pairwise spatial relationship cross the support and query images. The generated query-position-aware support features are robust to spatial misalignment and used to guide the detection network precisely. Our DAnA component is adaptable to various existing object detection networks and boosts FSOD performance by paying attention to specific semantics conditioned on the query. Experimental results demonstrate that DAnA significantly boosts (48 object detection performance on the COCO benchmark. By equipping DAnA, conventional object detection models, Faster-RCNN and RetinaNet, which are not designed explicitly for few-shot learning, reach state-of-the-art performance.

READ FULL TEXT

page 2

page 3

page 7

page 8

research
07/23/2020

Leveraging Bottom-Up and Top-Down Attention for Few-Shot Object Detection

Few-shot object detection aims at detecting objects with few annotated e...
research
06/15/2021

Dynamic Head: Unifying Object Detection Heads with Attentions

The complex nature of combining localization and classification in objec...
research
11/30/2020

AFD-Net: Adaptive Fully-Dual Network for Few-Shot Object Detection

Few-shot object detection (FSOD) aims at learning a detector that can fa...
research
11/27/2022

Breaking Immutable: Information-Coupled Prototype Elaboration for Few-Shot Object Detection

Few-shot object detection, expecting detectors to detect novel classes w...
research
09/16/2021

Few-Shot Object Detection by Attending to Per-Sample-Prototype

Few-shot object detection aims to detect instances of specific categorie...
research
10/25/2022

A Comparative Attention Framework for Better Few-Shot Object Detection on Aerial Images

Few-Shot Object Detection (FSOD) methods are mainly designed and evaluat...
research
04/02/2022

R(Det)^2: Randomized Decision Routing for Object Detection

In the paradigm of object detection, the decision head is an important p...

Please sign up or login with your details

Forgot password? Click here to reset