Bandwidth-Agile Image Transmission with Deep Joint Source-Channel Coding

09/26/2020
by   David Burth Kurka, et al.
0

We introduce deep learning based communication methods for adaptive-bandwidth transmission of images over wireless channels. We consider the scenario in which images are transmitted progressively in discrete layers over time or frequency, and such layers can be aggregated by receivers in order to increase the quality of their reconstructions. We investigate two scenarios, one in which the layers are sent sequentially, and incrementally contribute to the refinement of a reconstruction, and another in which the layers are independent and can be retrieved in any order. Those scenarios correspond to the well known problems of successive refinement and multiple descriptions, respectively, in the context of joint source-channel coding (JSCC). We propose DeepJSCC-l, an innovative solution that uses convolutional autoencoders, and present three different architectures with different complexity trade-offs. To the best of our knowledge, this is the first practical multiple-description JSCC scheme developed and tested for practical information sources and channels. Numerical results show that DeepJSCC-l can learn different strategies to divide the sources into a layered representation with negligible losses to the end-to-end performance when compared to a single transmission. Moreover, compared to state-of-the-art digital communication schemes, DeepJSCC-l performs well in the challenging low signal-to-noise ratio (SNR) and small bandwidth regimes, and provides graceful degradation with channel SNR.

READ FULL TEXT
research
03/15/2019

Successive Refinement of Images with Deep Joint Source-Channel Coding

We introduce deep learning based communication methods for successive re...
research
05/22/2023

DeepJSCC-l++: Robust and Bandwidth-Adaptive Wireless Image Transmission

This paper presents a novel vision transformer (ViT) based deep joint so...
research
09/04/2018

Deep Joint Source-Channel Coding for Wireless Image Transmission

We propose a joint source and channel coding (JSCC) technique for wirele...
research
10/09/2021

Deep Joint Source-Channel Coding for Wireless Image Transmission with Adaptive Rate Control

We present a novel adaptive deep joint source-channel coding (JSCC) sche...
research
11/25/2018

SparseCast: Hybrid Digital-Analog Wireless Image Transmission Exploiting Frequency Domain Sparsity

A hybrid digital-analog wireless image transmission scheme, called Spars...
research
08/16/2023

A Hybrid Wireless Image Transmission Scheme with Diffusion

We propose a hybrid joint source-channel coding (JSCC) scheme, in which ...
research
12/01/2020

Neural network-based on-chip spectroscopy using a scalable plasmonic encoder

Conventional spectrometers are limited by trade-offs set by size, cost, ...

Please sign up or login with your details

Forgot password? Click here to reset