Fast Object Detection with Latticed Multi-Scale Feature Fusion

11/05/2020
by   Yue Shi, et al.
6

Scale variance is one of the crucial challenges in multi-scale object detection. Early approaches address this problem by exploiting the image and feature pyramid, which raises suboptimal results with computation burden and constrains from inherent network structures. Pioneering works also propose multi-scale (i.e., multi-level and multi-branch) feature fusions to remedy the issue and have achieved encouraging progress. However, existing fusions still have certain limitations such as feature scale inconsistency, ignorance of level-wise semantic transformation, and coarse granularity. In this work, we present a novel module, the Fluff block, to alleviate drawbacks of current multi-scale fusion methods and facilitate multi-scale object detection. Specifically, Fluff leverages both multi-level and multi-branch schemes with dilated convolutions to have rapid, effective and finer-grained feature fusions. Furthermore, we integrate Fluff to SSD as FluffNet, a powerful real-time single-stage detector for multi-scale object detection. Empirical results on MS COCO and PASCAL VOC have demonstrated that FluffNet obtains remarkable efficiency with state-of-the-art accuracy. Additionally, we indicate the great generality of the Fluff block by showing how to embed it to other widely-used detectors as well.

READ FULL TEXT

page 1

page 3

page 4

page 7

research
11/12/2018

M2Det: A Single-Shot Object Detector based on Multi-Level Feature Pyramid Network

Feature pyramids are widely exploited by both the state-of-the-art one-s...
research
08/09/2021

Dynamic Multi-Scale Loss Optimization for Object Detection

With the continuous improvement of the performance of object detectors v...
research
11/16/2020

DSIC: Dynamic Sample-Individualized Connector for Multi-Scale Object Detection

Although object detection has reached a milestone thanks to the great su...
research
07/19/2023

Uncertainty-Driven Multi-Scale Feature Fusion Network for Real-time Image Deraining

Visual-based measurement systems are frequently affected by rainy weathe...
research
08/07/2020

Multi-Level Temporal Pyramid Network for Action Detection

Currently, one-stage frameworks have been widely applied for temporal ac...
research
01/19/2022

DMF-Net: Dual-Branch Multi-Scale Feature Fusion Network for copy forgery identification of anti-counterfeiting QR code

Anti-counterfeiting QR codes are widely used in people's work and life, ...
research
12/01/2020

Dynamic Feature Pyramid Networks for Object Detection

This paper studies feature pyramid network (FPN), which is a widely used...

Please sign up or login with your details

Forgot password? Click here to reset