Lossy Image Compression with Recurrent Neural Networks: from Human Perceived Visual Quality to Classification Accuracy

by   Maurice Weber, et al.

Deep neural networks have recently advanced the state-of-the-art in image compression and surpassed many traditional compression algorithms. The training of such networks involves carefully trading off entropy of the latent representation against reconstruction quality. The term quality crucially depends on the observer of the images which, in the vast majority of literature, is assumed to be human. In this paper, we go beyond this notion of quality and look at human visual perception and machine perception simultaneously. To that end, we propose a family of loss functions that allows to optimize deep image compression depending on the observer and to interpolate between human perceived visual quality and classification accuracy. Our experiments show that our proposed training objectives result in compression systems that, when trained with machine friendly loss, preserve accuracy much better than the traditional codecs BPG, WebP and JPEG, without requiring fine-tuning of inference algorithms on decoded images and independent of the classifier architecture. At the same time, when using the human friendly loss, we achieve competitive performance in terms of MS-SSIM.


page 1

page 5

page 9

page 12

page 13


HFLIC: Human Friendly Perceptual Learned Image Compression with Reinforced Transform

In recent years, there has been rapid development in learned image compr...

Humans are still the best lossy image compressors

Lossy image compression has been studied extensively in the context of t...

Towards improved lossy image compression: Human image reconstruction with public-domain images

Lossy image compression has been studied extensively in the context of t...

Deep Selector-JPEG: Adaptive JPEG Image Compression for Computer Vision in Image classification with Human Vision Criteria

With limited storage/bandwidth resources, input images to Computer Visio...

Deformation Aware Image Compression

Lossy compression algorithms aim to compactly encode images in a way whi...

Generalized Ternary Connect: End-to-End Learning and Compression of Multiplication-Free Deep Neural Networks

The use of deep neural networks in edge computing devices hinges on the ...

Customized OCT images compression scheme with deep neural network

We customize an end-to-end image compression framework for retina OCT im...

Please sign up or login with your details

Forgot password? Click here to reset