DeepAI
Log In Sign Up

AFD-Net: Adaptive Fully-Dual Network for Few-Shot Object Detection

11/30/2020
by   Longyao Liu, et al.
0

Few-shot object detection (FSOD) aims at learning a detector that can fast adapt to previously unseen objects with scarce annotated examples, which is challenging and demanding. Existing methods solve this problem by performing subtasks of classification and localization utilizing a shared component (e.g., RoI head) in a detector, yet few of them take the preference difference in embedding space of two subtasks into consideration. In this paper, we carefully analyze the characteristics of FSOD and present that a general few-shot detector should consider the explicit decomposition of two subtasks, and leverage information from both of them for enhancing feature representations. To the end, we propose a simple yet effective Adaptive Fully-Dual Network (AFD-Net). Specifically, we extend Faster R-CNN by introducing Dual Query Encoder and Dual Attention Generator for separate feature extraction, and Dual Aggregator for separate model reweighting. Spontaneously, separate decision making is achieved with the R-CNN detector. Besides, for the acquisition of enhanced feature representations, we further introduce Adaptive Fusion Mechanism to adaptively perform feature fusion suitable for the specific subtask. Extensive experiments on PASCAL VOC and MS COCO in various settings show that, our method achieves new state-of-the-art performance by a large margin, demonstrating its effectiveness and generalization ability.

READ FULL TEXT

page 1

page 2

page 3

page 4

08/20/2021

DeFRCN: Decoupled Faster R-CNN for Few-Shot Object Detection

Few-shot object detection, which aims at detecting novel objects rapidly...
02/24/2021

Should I Look at the Head or the Tail? Dual-awareness Attention for Few-Shot Object Detection

While recent progress has significantly boosted few-shot classification ...
02/08/2019

A Single-shot Object Detector with Feature Aggragation and Enhancement

For many real applications, it is equally important to detect objects ac...
03/19/2018

Revisiting RCNN: On Awakening the Classification Power of Faster RCNN

Recent region-based object detectors are usually built with separate cla...
03/17/2022

Semantic-aligned Fusion Transformer for One-shot Object Detection

One-shot object detection aims at detecting novel objects according to m...
05/06/2020

Low-shot Object Detection via Classification Refinement

This work aims to address the problem of low-shot object detection, wher...
01/23/2017

DSSD : Deconvolutional Single Shot Detector

The main contribution of this paper is an approach for introducing addit...