DeepAI AI Chat
Log In Sign Up

An Empirical Study of Adder Neural Networks for Object Detection

12/27/2021
by   Xinghao Chen, et al.
HUAWEI Technologies Co., Ltd.
The University of Sydney
10

Adder neural networks (AdderNets) have shown impressive performance on image classification with only addition operations, which are more energy efficient than traditional convolutional neural networks built with multiplications. Compared with classification, there is a strong demand on reducing the energy consumption of modern object detectors via AdderNets for real-world applications such as autonomous driving and face detection. In this paper, we present an empirical study of AdderNets for object detection. We first reveal that the batch normalization statistics in the pre-trained adder backbone should not be frozen, since the relatively large feature variance of AdderNets. Moreover, we insert more shortcut connections in the neck part and design a new feature fusion architecture for avoiding the sparse features of adder layers. We present extensive ablation studies to explore several design choices of adder detectors. Comparisons with state-of-the-arts are conducted on COCO and PASCAL VOC benchmarks. Specifically, the proposed Adder FCOS achieves a 37.8% AP on the COCO val set, demonstrating comparable performance to that of the convolutional counterpart with an about 1.4× energy reduction.

READ FULL TEXT

page 5

page 10

page 14

page 15

01/17/2023

FemtoDet: An Object Detection Baseline for Energy Versus Performance Tradeoffs

Efficient detectors for edge devices are often optimized for metrics lik...
08/23/2022

A Comprehensive Study of Real-Time Object Detection Networks Across Multiple Domains: A Survey

Deep neural network based object detectors are continuously evolving and...
06/03/2020

DetectoRS: Detecting Objects with Recursive Feature Pyramid and Switchable Atrous Convolution

Many modern object detectors demonstrate outstanding performances by usi...
11/26/2020

Energy Drain of the Object Detection Processing Pipeline for Mobile Devices: Analysis and Implications

Applying deep learning to object detection provides the capability to ac...
07/01/2021

CBNetV2: A Composite Backbone Network Architecture for Object Detection

Consistent performance gains through exploring more effective network st...
04/22/2019

An Energy and GPU-Computation Efficient Backbone Network for Real-Time Object Detection

As DenseNet conserves intermediate features with diverse receptive field...