AutoMC: Automated Model Compression based on Domain Knowledge and Progressive search strategy

01/24/2022
by   Chunnan Wang, et al.
0

Model compression methods can reduce model complexity on the premise of maintaining acceptable performance, and thus promote the application of deep neural networks under resource constrained environments. Despite their great success, the selection of suitable compression methods and design of details of the compression scheme are difficult, requiring lots of domain knowledge as support, which is not friendly to non-expert users. To make more users easily access to the model compression scheme that best meet their needs, in this paper, we propose AutoMC, an effective automatic tool for model compression. AutoMC builds the domain knowledge on model compression to deeply understand the characteristics and advantages of each compression method under different settings. In addition, it presents a progressive search strategy to efficiently explore pareto optimal compression scheme according to the learned prior knowledge combined with the historical evaluation information. Extensive experimental results show that AutoMC can provide satisfying compression schemes within short time, demonstrating the effectiveness of AutoMC.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/03/2023

ProgDTD: Progressive Learned Image Compression with Double-Tail-Drop Training

Progressive compression allows images to start loading as low-resolution...
research
06/20/2023

About some compression algorithms

We use neural network algorithms for finding compression methods of imag...
research
04/29/2021

Spirit Distillation: A Model Compression Method with Multi-domain Knowledge Transfer

Recent applications pose requirements of both cross-domain knowledge tra...
research
04/13/2023

Learning Accurate Performance Predictors for Ultrafast Automated Model Compression

In this paper, we propose an ultrafast automated model compression frame...
research
02/22/2023

RNA secondary structures: from ab initio prediction to better compression, and back

In this paper, we use the biological domain knowledge incorporated into ...
research
03/31/2023

Domain Knowledge integrated for Blast Furnace Classifier Design

Blast furnace modeling and control is one of the important problems in t...
research
06/22/2022

ROIBIN-SZ: Fast and Science-Preserving Compression for Serial Crystallography

Crystallography is the leading technique to study atomic structures of p...

Please sign up or login with your details

Forgot password? Click here to reset