Compressing Weight-updates for Image Artifacts Removal Neural Networks

05/10/2019
by   Yat Hong Lam, et al.
0

In this paper, we present a novel approach for fine-tuning a decoder-side neural network in the context of image compression, such that the weight-updates are better compressible. At encoder side, we fine-tune a pre-trained artifact removal network on target data by using a compression objective applied on the weight-update. In particular, the compression objective encourages weight-updates which are sparse and closer to quantized values. This way, the final weight-update can be compressed more efficiently by pruning and quantization, and can be included into the encoded bitstream together with the image bitstream of a traditional codec. We show that this approach achieves reconstruction quality which is on-par or slightly superior to a traditional codec, at comparable bitrates. To our knowledge, this is the first attempt to combine image compression and neural network's weight update compression.

READ FULL TEXT
research
07/22/2022

Quantized Sparse Weight Decomposition for Neural Network Compression

In this paper, we introduce a novel method of neural network weight comp...
research
07/28/2020

Efficient Adaptation of Neural Network Filter for Video Compression

We present an efficient finetuning methodology for neural-network filter...
research
08/14/2023

Unified Data-Free Compression: Pruning and Quantization without Fine-Tuning

Structured pruning and quantization are promising approaches for reducin...
research
09/15/2020

Learning a Single Model with a Wide Range of Quality Factors for JPEG Image Artifacts Removal

Lossy compression brings artifacts into the compressed image and degrade...
research
05/28/2018

BlockCNN: A Deep Network for Artifact Removal and Image Compression

We present a general technique that performs both artifact removal and i...
research
02/08/2019

Architecture Compression

In this paper we propose a novel approach to model compression termed Ar...
research
09/02/2023

eDKM: An Efficient and Accurate Train-time Weight Clustering for Large Language Models

Since Large Language Models or LLMs have demonstrated high-quality perfo...

Please sign up or login with your details

Forgot password? Click here to reset