Adaptive Information Bottleneck Guided Joint Source-Channel Coding

03/12/2022
by   Lunan Sun, et al.
0

Joint source channel coding (JSCC) has attracted increasing attentions due to its robustness and high efficiency. However, the existing research on JSCC mainly focuses on minimizing the distortion between the transmitted and received information, while limiting the required data rate. Therefore, even though the transmitted information is well recovered, the transmitted bits may be far more than the minimal threshold according to the rate-distortion (RD) theory. In this paper, we propose an adaptive Information Bottleneck (IB) guided JSCC (AIB-JSCC), which aims at achieving the theoretically maximal compression ratio for a given reconstruction quality. In particular, we first derive a mathematically tractable form of loss function for AIB-JSCC. To keep a better tradeoff between compression and reconstruction quality, we further propose an adaptive algorithm that adjusts hyperparameter beta of the proposed loss function dynamically according to the distortion during training. Experiment results show that AIB-JSCC can significantly reduce the required amount of the transmitted data and improve the reconstruction quality and downstream artificial-intelligent task performance.

READ FULL TEXT

page 1

page 9

research
09/19/2023

Disentangled Information Bottleneck guided Privacy-Protective JSCC for Image Transmission

Joint source and channel coding (JSCC) has attracted increasing attentio...
research
01/08/2020

Adaptive Coding for Two-Way Lossy Source-Channel Communication

An adaptive joint source-channel coding (JSCC) scheme is presented for t...
research
09/15/2023

Privacy-Aware Joint Source-Channel Coding for image transmission based on Disentangled Information Bottleneck

Current privacy-aware joint source-channel coding (JSCC) works aim at av...
research
07/19/2021

Conveying individual source sequences over memoryless channels using finite-state decoders with source side information

We study the following semi-deterministic setting of the joint source-ch...
research
11/08/2022

Adaptive Semantic Communications: Overfitting the Source and Channel for Profit

Most semantic communication systems leverage deep learning models to pro...
research
08/05/2019

Minimum Energy for Gaussian Joint source-channel Coding with a Square-law Distortion-Noise Profile

A distortion-noise profile is a function indicating the maximum allowed ...
research
06/23/2018

Optimizing Lossy Compression Rate-Distortion from Automatic Online Selection between SZ and ZFP

With ever-increasing volumes of scientific data produced by HPC applicat...

Please sign up or login with your details

Forgot password? Click here to reset