DeepAI AI Chat
Log In Sign Up

Conditional Probability Models for Deep Image Compression

01/12/2018
by   Fabian Mentzer, et al.
ETH Zurich
0

Deep Neural Networks trained as image auto-encoders have recently emerged as a promising direction for advancing the state of the art in image compression. The key challenge in learning such networks is twofold: to deal with quantization, and to control the trade-off between reconstruction error (distortion) and entropy (rate) of the latent image representation. In this paper, we focus on the latter challenge and propose a new technique to navigate the rate-distortion trade-off for an image compression auto-encoder. The main idea is to directly model the entropy of the latent representation by using a context model: a 3D-CNN which learns a conditional probability model of the latent distribution of the auto-encoder. During training, the auto-encoder makes use of the context model to estimate the entropy of its representation, and the context model is concurrently updated to learn the dependencies between the symbols in the latent representation. Our experiments show that this approach yields a state-of-the-art image compression system based on a simple convolutional auto-encoder.

READ FULL TEXT

page 11

page 12

page 13

page 14

page 15

page 16

page 17

page 18

05/28/2018

Block-optimized Variable Bit Rate Neural Image Compression

In this work, we propose an end-to-end block-based auto-encoder system f...
06/22/2020

Modeling Lost Information in Lossy Image Compression

Lossy image compression is one of the most commonly used operators for d...
04/10/2021

Latent Code-Based Fusion: A Volterra Neural Network Approach

We propose a deep structure encoder using the recently introduced Volter...
03/28/2018

Context-aware Deep Feature Compression for High-speed Visual Tracking

We propose a new context-aware correlation filter based tracking framewo...
04/01/2019

Layered Image Compression using Scalable Auto-encoder

This paper presents a novel convolutional neural network (CNN) based ima...
04/22/2019

Non-local Attention Optimized Deep Image Compression

This paper proposes a novel Non-Local Attention Optimized Deep Image Com...
07/03/2020

Improving auto-encoder novelty detection using channel attention and entropy minimization

Novelty detection is a important research area which mainly solves the c...