DeepAI AI Chat
Log In Sign Up

Conditional Probability Models for Deep Image Compression

by   Fabian Mentzer, et al.
ETH Zurich

Deep Neural Networks trained as image auto-encoders have recently emerged as a promising direction for advancing the state of the art in image compression. The key challenge in learning such networks is twofold: to deal with quantization, and to control the trade-off between reconstruction error (distortion) and entropy (rate) of the latent image representation. In this paper, we focus on the latter challenge and propose a new technique to navigate the rate-distortion trade-off for an image compression auto-encoder. The main idea is to directly model the entropy of the latent representation by using a context model: a 3D-CNN which learns a conditional probability model of the latent distribution of the auto-encoder. During training, the auto-encoder makes use of the context model to estimate the entropy of its representation, and the context model is concurrently updated to learn the dependencies between the symbols in the latent representation. Our experiments show that this approach yields a state-of-the-art image compression system based on a simple convolutional auto-encoder.


page 11

page 12

page 13

page 14

page 15

page 16

page 17

page 18


Block-optimized Variable Bit Rate Neural Image Compression

In this work, we propose an end-to-end block-based auto-encoder system f...

Modeling Lost Information in Lossy Image Compression

Lossy image compression is one of the most commonly used operators for d...

Latent Code-Based Fusion: A Volterra Neural Network Approach

We propose a deep structure encoder using the recently introduced Volter...

Context-aware Deep Feature Compression for High-speed Visual Tracking

We propose a new context-aware correlation filter based tracking framewo...

Layered Image Compression using Scalable Auto-encoder

This paper presents a novel convolutional neural network (CNN) based ima...

Non-local Attention Optimized Deep Image Compression

This paper proposes a novel Non-Local Attention Optimized Deep Image Com...

Improving auto-encoder novelty detection using channel attention and entropy minimization

Novelty detection is a important research area which mainly solves the c...