Scale-Equalizing Pyramid Convolution for Object Detection

by   Xinjiang Wang, et al.

Feature pyramid has been an efficient method to extract features at different scales. Development over this method mainly focuses on aggregating contextual information at different levels while seldom touching the inter-level correlation in the feature pyramid. Early computer vision methods extracted scale-invariant features by locating the feature extrema in both spatial and scale dimension. Inspired by this, a convolution across the pyramid level is proposed in this study, which is termed pyramid convolution and is a modified 3-D convolution. Stacked pyramid convolutions directly extract 3-D (scale and spatial) features and outperforms other meticulously designed feature fusion modules. Based on the viewpoint of 3-D convolution, an integrated batch normalization that collects statistics from the whole feature pyramid is naturally inserted after the pyramid convolution. Furthermore, we also show that the naive pyramid convolution, together with the design of RetinaNet head, actually best applies for extracting features from a Gaussian pyramid, whose properties can hardly be satisfied by a feature pyramid. In order to alleviate this discrepancy, we build a scale-equalizing pyramid convolution (SEPC) that aligns the shared pyramid convolution kernel only at high-level feature maps. Being computationally efficient and compatible with the head design of most single-stage object detectors, the SEPC module brings significant performance improvement (>4AP increase on MS-COCO2017 dataset) in state-of-the-art one-stage object detectors, and a light version of SEPC also has ∼3.5AP gain with only around 7 functions well as a stand-alone module in two-stage object detectors and is able to improve the performance by ∼2AP. The source code can be found at


page 3

page 5

page 12


M2Det: A Single-Shot Object Detector based on Multi-Level Feature Pyramid Network

Feature pyramids are widely exploited by both the state-of-the-art one-s...

CE-FPN: Enhancing Channel Information for Object Detection

Feature pyramid network (FPN) has been an effective framework to extract...

Photovoltaic Panel Defect Detection Based on Ghost Convolution with BottleneckCSP and Tiny Target Prediction Head Incorporating YOLOv5

Photovoltaic (PV) panel surface-defect detection technology is crucial f...

Tea Chrysanthemum Detection under Unstructured Environments Using the TC-YOLO Model

Tea chrysanthemum detection at its flowering stage is one of the key com...

Pyramid Point: A Multi-Level Focusing Network for Revisiting Feature Layers

We present a method to learn a diverse group of object categories from a...

Delving into the Scale Variance Problem in Object Detection

Object detection has made substantial progress in the last decade, due t...

Please sign up or login with your details

Forgot password? Click here to reset