DeepAI AI Chat

Pruning Algorithms to Accelerate Convolutional Neural Networks for Edge Applications: A Survey

05/08/2020

∙

by Jiayi Liu, et al.

∙

LG Electronics Inc

∙

∙

With the general trend of increasing Convolutional Neural Network (CNN) model sizes, model compression and acceleration techniques have become critical for the deployment of these models on edge devices. In this paper, we provide a comprehensive survey on Pruning, a major compression strategy that removes non-critical or redundant neurons from a CNN model. The survey covers the overarching motivation for pruning, different strategies and criteria, their advantages and drawbacks, along with a compilation of major pruning techniques. We conclude the survey with a discussion on alternatives to pruning and current challenges for the model compression community.

Jiayi Liu
22 publications
Samarth Tripathi
8 publications
Unmesh Kurup
10 publications
Mohak Shah
15 publications

page 1

page 2

page 3

page 4

∙ 10/23/2017

A Survey of Model Compression and Acceleration for Deep Neural Networks

Deep convolutional neural networks (CNNs) have recently achieved great s...

0 Yu Cheng, et al. ∙

∙ 02/03/2018

A Survey on Acceleration of Deep Convolutional Neural Networks

Deep Neural Networks have achieved remarkable progress during the past f...

0 Jian Cheng, et al. ∙

∙ 06/14/2018

SCSP: Spectral Clustering Filter Pruning with Soft Self-adaption Manners

Deep Convolutional Neural Networks (CNN) has achieved significant succes...

0 Huiyuan Zhuo, et al. ∙

∙ 04/25/2018

Structured Deep Neural Network Pruning by Varying Regularization Parameters

Convolutional Neural Networks (CNN's) are restricted by their massive co...

0 Huan Wang, et al. ∙

∙ 11/19/2018

Three Dimensional Convolutional Neural Network Pruning with Regularization-Based Method

In recent years, three-dimensional convolutional neural network (3D CNN)...

0 Yuxin Zhang, et al. ∙

∙ 10/24/2019

A Comparative Study of Neural Network Compression

There has recently been an increasing desire to evaluate neural networks...

0 Hossein Baktash, et al. ∙

∙ 01/12/2021

Convolutional Neural Network Simplification with Progressive Retraining

Kernel pruning methods have been proposed to speed up, simplify, and imp...

0 D. Osaku, et al. ∙