AI Chat AI Image Generator AI Video Text to Speech

Pruning Algorithms to Accelerate Convolutional Neural Networks for Edge Applications: A Survey

05/08/2020

∙

by Jiayi Liu, et al.

∙

∙

With the general trend of increasing Convolutional Neural Network (CNN) model sizes, model compression and acceleration techniques have become critical for the deployment of these models on edge devices. In this paper, we provide a comprehensive survey on Pruning, a major compression strategy that removes non-critical or redundant neurons from a CNN model. The survey covers the overarching motivation for pruning, different strategies and criteria, their advantages and drawbacks, along with a compilation of major pruning techniques. We conclude the survey with a discussion on alternatives to pruning and current challenges for the model compression community.

Jiayi Liu
26 publications
Samarth Tripathi
8 publications
Unmesh Kurup
10 publications
Mohak Shah
15 publications

page 1

page 2

page 3

page 4

research

∙ 10/23/2017

A Survey of Model Compression and Acceleration for Deep Neural Networks

Deep convolutional neural networks (CNNs) have recently achieved great s...

0 Yu Cheng, et al. ∙

research

∙ 08/13/2023

A Survey on Deep Neural Network Pruning-Taxonomy, Comparison, Analysis, and Recommendations

Modern deep neural networks, particularly recent large language models, ...

0 Hongrong Cheng, et al. ∙

research

∙ 02/03/2018

A Survey on Acceleration of Deep Convolutional Neural Networks

Deep Neural Networks have achieved remarkable progress during the past f...

0 Jian Cheng, et al. ∙

research

∙ 06/14/2018

SCSP: Spectral Clustering Filter Pruning with Soft Self-adaption Manners

Deep Convolutional Neural Networks (CNN) has achieved significant succes...

0 Huiyuan Zhuo, et al. ∙

research

∙ 04/25/2018

Structured Deep Neural Network Pruning by Varying Regularization Parameters

Convolutional Neural Networks (CNN's) are restricted by their massive co...

0 Huan Wang, et al. ∙

research

∙ 11/19/2018

Three Dimensional Convolutional Neural Network Pruning with Regularization-Based Method

In recent years, three-dimensional convolutional neural network (3D CNN)...

0 Yuxin Zhang, et al. ∙

research

∙ 02/20/2020

Performance Aware Convolutional Neural Network Channel Pruning for Embedded GPUs

Convolutional Neural Networks (CNN) are becoming a common presence in ma...

7 Valentin Radu, et al. ∙