Deep Stereo Image Compression with Decoder Side Information using Wyner Common Information

06/22/2021
by   Nitish Mital, et al.
11

We present a novel deep neural network (DNN) architecture for compressing an image when a correlated image is available as side information only at the decoder. This problem is known as distributed source coding (DSC) in information theory. In particular, we consider a pair of stereo images, which generally have high correlation with each other due to overlapping fields of view, and assume that one image of the pair is to be compressed and transmitted, while the other image is available only at the decoder. In the proposed architecture, the encoder maps the input image to a latent space, quantizes the latent representation, and compresses it using entropy coding. The decoder is trained to extract the Wyner's common information between the input image and the correlated image from the latter. The received latent representation and the locally generated common information are passed through a decoder network to obtain an enhanced reconstruction of the input image. The common information provides a succinct representation of the relevant information at the receiver. We train and demonstrate the effectiveness of the proposed approach on the KITTI dataset of stereo image pairs. Our results show that the proposed architecture is capable of exploiting the decoder-only side information, and outperforms previous work on stereo image compression with decoder side information.

READ FULL TEXT

page 8

page 9

page 14

page 15

page 16

page 17

page 18

page 19

research
07/18/2022

Neural Distributed Image Compression with Cross-Attention Feature Alignment

We propose a novel deep neural network (DNN) architecture for compressin...
research
01/14/2020

Deep Image Compression using Decoder Side Information

We present a Deep Image Compression neural network that relies on side i...
research
09/20/2023

Neural Image Compression Using Masked Sparse Visual Representation

We study neural image compression based on the Sparse Visual Representat...
research
08/09/2019

DSIC: Deep Stereo Image Compression

In this paper we tackle the problem of stereo image compression, and lev...
research
01/25/2022

Distributed Image Transmission using Deep Joint Source-Channel Coding

We study the problem of deep joint source-channel coding (D-JSCC) for co...
research
07/18/2023

ECSIC: Epipolar Cross Attention for Stereo Image Compression

In this paper, we present ECSIC, a novel learned method for stereo image...
research
03/01/2019

A Deep DUAL-PATH Network for Improved Mammogram Image Processing

We present, for the first time, a novel deep neural network architecture...

Please sign up or login with your details

Forgot password? Click here to reset