CAE-ADMM: Implicit Bitrate Optimization via ADMM-based Pruning in Compressive Autoencoders

01/22/2019
by   Haimeng Zhao, et al.
0

We introduce CAE-ADMM (ADMM-pruned compressive autoencoder), a lossy image compression model, inspired by researches in neural architecture search (NAS) and is capable of implicitly optimizing the bitrate without the use of an entropy estimator. Our experiments show that by introducing alternating direction method of multipliers (ADMM) to the model pipeline, the pruning paradigm yields more accurate results (SSIM/MS-SSIM-wise) when compared to entropy-based approaches and that of traditional codecs (JPEG, JPEG 2000, etc.) while maintaining acceptable inference speed. We further explore the effectiveness of the pruning method in CAE-ADMM by examining the generated latent codes.

READ FULL TEXT

page 1

page 4

research
01/22/2019

CAE-P: Compressive Autoencoder with Pruning Based on ADMM

Since compressive autoencoder (CAE) was proposed, autoencoder, as a simp...
research
02/15/2018

Systematic Weight Pruning of DNNs using Alternating Direction Method of Multipliers

We present a systematic weight pruning framework of deep neural networks...
research
03/16/2016

Norm-1 Regularized Consensus-based ADMM for Imaging with a Compressive Antenna

This paper presents a novel norm-one-regularized, consensus-based imagin...
research
11/13/2018

Consensus and Sectioning-based ADMM with Norm-1 Regularization for Imaging with a Compressive Reflector Antenna

This paper presents three distributed techniques to find a sparse soluti...
research
04/30/2019

ResNet Can Be Pruned 60x: Introducing Network Purification and Unused Path Removal (P-RM) after Weight Pruning

The state-of-art DNN structures involve high computation and great deman...
research
02/28/2023

Modular and Parallelizable Multibody Physics Simulation via Subsystem-Based ADMM

In this paper, we present a new multibody physics simulation framework t...
research
02/03/2021

PARAFAC2 AO-ADMM: Constraints in all modes

The PARAFAC2 model provides a flexible alternative to the popular CANDEC...

Please sign up or login with your details

Forgot password? Click here to reset