Optimized learned entropy coding parameters for practical neural-based image and video compression

01/20/2023
by   Amir Said, et al.
0

Neural-based image and video codecs are significantly more power-efficient when weights and activations are quantized to low-precision integers. While there are general-purpose techniques for reducing quantization effects, large losses can occur when specific entropy coding properties are not considered. This work analyzes how entropy coding is affected by parameter quantizations, and provides a method to minimize losses. It is shown that, by using a certain type of coding parameters to be learned, uniform quantization becomes practically optimal, also simplifying the minimization of code memory requirements. The mathematical properties of the new representation are presented, and its effectiveness is demonstrated by coding experiments, showing that good results can be obtained with precision as low as 4 bits per network output, and practically no loss with 8 bits.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/02/2022

Device Interoperability for Learned Image Compression with Weights and Activations Quantization

Learning-based image compression has improved to a level where it can ou...
research
07/09/2022

Video Coding Using Learned Latent GAN Compression

We propose in this paper a new paradigm for facial video compression. We...
research
07/12/2021

HEMP: High-order Entropy Minimization for neural network comPression

We formulate the entropy of a quantized artificial neural network as a d...
research
04/26/2022

A New Spin on Color Quantization

We address the problem of image color quantization using a Maximum Entro...
research
02/21/2019

Learned Step Size Quantization

We present here Learned Step Size Quantization, a method for training de...
research
12/23/2011

Critical Data Compression

A new approach to data compression is developed and applied to multimedi...
research
03/18/2020

Object-Based Image Coding: A Learning-Driven Revisit

The Object-Based Image Coding (OBIC) that was extensively studied about ...

Please sign up or login with your details

Forgot password? Click here to reset