Delving into the Scale Variance Problem in Object Detection

06/16/2022
by   Junliang Chen, et al.
0

Object detection has made substantial progress in the last decade, due to the capability of convolution in extracting local context of objects. However, the scales of objects are diverse and current convolution can only process single-scale input. The capability of traditional convolution with a fixed receptive field in dealing with such a scale variance problem, is thus limited. Multi-scale feature representation has been proven to be an effective way to mitigate the scale variance problem. Recent researches mainly adopt partial connection with certain scales, or aggregate features from all scales and focus on the global information across the scales. However, the information across spatial and depth dimensions is ignored. Inspired by this, we propose the multi-scale convolution (MSConv) to handle this problem. Taking into consideration scale, spatial and depth information at the same time, MSConv is able to process multi-scale input more comprehensively. MSConv is effective and computationally efficient, with only a small increase of computational cost. For most of the single-stage object detectors, replacing the traditional convolutions with MSConvs in the detection head can bring more than 2.5% improvement in AP (on COCO 2017 dataset), with only 3% increase of FLOPs. MSConv is also flexible and effective for two-stage object detectors. When extended to the mainstream two-stage object detectors, MSConv can bring up to 3.0% improvement in AP. Our best model under single-scale testing achieves 48.9% AP on COCO 2017 test-dev split, which surpasses many state-of-the-art methods.

READ FULL TEXT
research
06/16/2022

Selective Multi-Scale Learning for Object Detection

Pyramidal networks are standard methods for multi-scale object detection...
research
09/05/2019

POD: Practical Object Detection with Scale-Sensitive Network

Scale-sensitive object detection remains a challenging task, where most ...
research
05/06/2020

Scale-Equalizing Pyramid Convolution for Object Detection

Feature pyramid has been an efficient method to extract features at diff...
research
06/19/2021

AdaZoom: Adaptive Zoom Network for Multi-Scale Object Detection in Large Scenes

Detection in large-scale scenes is a challenging problem due to small ob...
research
07/12/2023

YOGA: Deep Object Detection in the Wild with Lightweight Feature Learning and Multiscale Attention

We introduce YOGA, a deep learning based yet lightweight object detectio...
research
07/09/2018

Pooling Pyramid Network for Object Detection

We'd like to share a simple tweak of Single Shot Multibox Detector (SSD)...
research
12/01/2020

Dynamic Feature Pyramid Networks for Object Detection

This paper studies feature pyramid network (FPN), which is a widely used...

Please sign up or login with your details

Forgot password? Click here to reset