Visual Saliency-Guided Channel Pruning for Deep Visual Detectors in Autonomous Driving

03/04/2023
by   Jung Im Choi, et al.
0

Deep neural network (DNN) pruning has become a de facto component for deploying on resource-constrained devices since it can reduce memory requirements and computation costs during inference. In particular, channel pruning gained more popularity due to its structured nature and direct savings on general hardware. However, most existing pruning approaches utilize importance measures that are not directly related to the task utility. Moreover, few in the literature focus on visual detection models. To fill these gaps, we propose a novel gradient-based saliency measure for visual detection and use it to guide our channel pruning. Experiments on the KITTI and COCO traffic datasets demonstrate our pruning method's efficacy and superiority over state-of-the-art competing approaches. It can even achieve better performance with fewer parameters than the original model. Our pruning also demonstrates great potential in handling small-scale objects.

READ FULL TEXT

page 3

page 5

research
09/07/2022

Interpretations Steered Network Pruning via Amortized Inferred Saliency Maps

Convolutional Neural Networks (CNNs) compression is crucial to deploying...
research
10/24/2021

Exploring Gradient Flow Based Saliency for DNN Model Compression

Model pruning aims to reduce the deep neural network (DNN) model size or...
research
04/03/2020

Composition of Saliency Metrics for Channel Pruning with a Myopic Oracle

The computation and memory needed for Convolutional Neural Network (CNN)...
research
10/24/2018

Distilling with Performance Enhanced Students

The task of accelerating large neural networks on general purpose hardwa...
research
11/08/2020

Channel Pruning Guided by Spatial and Channel Attention for DNNs in Intelligent Edge Computing

Deep Neural Networks (DNNs) have achieved remarkable success in many com...
research
10/21/2021

Evolving Transferable Pruning Functions

Channel pruning has made major headway in the design of efficient deep l...
research
05/04/2022

Domino Saliency Metrics: Improving Existing Channel Saliency Metrics with Structural Information

Channel pruning is used to reduce the number of weights in a Convolution...

Please sign up or login with your details

Forgot password? Click here to reset