StageInteractor: Query-based Object Detector with Cross-stage Interaction

04/11/2023
by   Yao Teng, et al.
0

Previous object detectors make predictions based on dense grid points or numerous preset anchors. Most of these detectors are trained with one-to-many label assignment strategies. On the contrary, recent query-based object detectors depend on a sparse set of learnable queries and a series of decoder layers. The one-to-one label assignment is independently applied on each layer for the deep supervision during training. Despite the great success of query-based object detection, however, this one-to-one label assignment strategy demands the detectors to have strong fine-grained discrimination and modeling capacity. To solve the above problems, in this paper, we propose a new query-based object detector with cross-stage interaction, coined as StageInteractor. During the forward propagation, we come up with an efficient way to improve this modeling ability by reusing dynamic operators with lightweight adapters. As for the label assignment, a cross-stage label assigner is applied subsequent to the one-to-one label assignment. With this assigner, the training target class labels are gathered across stages and then reallocated to proper predictions at each decoder layer. On MS COCO benchmark, our model improves the baseline by 2.2 AP, and achieves 44.8 AP with ResNet-50 as backbone, 100 queries and 12 training epochs. With longer training time and 300 queries, StageInteractor achieves 51.1 AP and 52.2 AP with ResNeXt-101-DCN and Swin-S, respectively.

READ FULL TEXT
research
03/22/2023

Dense Distinct Query for End-to-End Object Detection

One-to-one label assignment in object detection has successfully obviate...
research
03/30/2022

AdaMixer: A Fast-Converging Query-Based Object Detector

Traditional object detectors employ the dense paradigm of scanning over ...
research
08/18/2023

Deep Equilibrium Object Detection

Query-based object detectors directly decode image features into object ...
research
12/15/2022

Enhanced Training of Query-Based Object Detection via Selective Query Recollection

This paper investigates a phenomenon where query-based object detectors ...
research
04/14/2021

IQDet: Instance-wise Quality Distribution Sampling for Object Detection

We propose a dense object detector with an instance-wise sampling strate...
research
03/15/2022

Progressive End-to-End Object Detection in Crowded Scenes

In this paper, we propose a new query-based detection framework for crow...
research
10/05/2022

FQDet: Fast-converging Query-based Detector

Recently, two-stage Deformable DETR introduced the query-based two-stage...

Please sign up or login with your details

Forgot password? Click here to reset