Multi-objective Pruning for CNNs using Genetic Algorithm

06/02/2019
by   Chuanguang Yang, et al.
0

In this work, we propose a heuristic genetic algorithm (GA) for pruning convolutional neural networks (CNNs) according to the multi-objective trade-off among error, computation and sparsity. In our experiments, we apply our approach to prune pre-trained LeNet across the MNIST dataset, which reduces 95.42 computation with tiny accuracy loss by laying emphasis on sparsity and computation, respectively. Our empirical study suggests that GA is an alternative pruning approach for obtaining a competitive compression performance. Additionally, compared with state-of-the-art approaches, GA is capable of automatically pruning CNNs based on the multi-objective importance by a pre-defined fitness function.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/05/2023

Continuous Cartesian Genetic Programming based representation for Multi-Objective Neural Architecture Search

We propose a novel approach for the challenge of designing less complex ...
research
05/14/2021

Multi-Objective Optimisation of Cortical Spiking Neural Networks With Genetic Algorithms

Spiking neural networks (SNNs) communicate through the all-or-none spiki...
research
07/21/2023

CycleIK: Neuro-inspired Inverse Kinematics

The paper introduces CycleIK, a neuro-robotic approach that wraps two no...
research
03/18/2022

Automated Materials Spectroscopy Analysis using Genetic Algorithms

We introduce a Genetic Algorithm (GA) based, open-source project to solv...
research
04/05/2015

Heuristic algorithms for obtaining Polynomial Threshold Functions with low densities

In this paper we present several heuristic algorithms, including a Genet...
research
01/25/2023

NASCTY: Neuroevolution to Attack Side-channel Leakages Yielding Convolutional Neural Networks

Side-channel analysis (SCA) can obtain information related to the secret...
research
07/08/2023

A Novel Pseudo-Random Number Generator Based on Multi-Objective Optimization for Image-Cryptographic Applications

Pseudo-random number generators (PRNGs) play an important role to ensure...

Please sign up or login with your details

Forgot password? Click here to reset