Robust Information Bottleneck for Task-Oriented Communication with Digital Modulation

09/21/2022
by   Songjie Xie, et al.
0

Task-oriented communications, mostly using learning-based joint source-channel coding (JSCC), aim to design a communication-efficient edge inference system by transmitting task-relevant information to the receiver. However, only transmitting task-relevant information without introducing any redundancy may cause robustness issues in learning due to the channel variations, and the JSCC which directly maps the source data into continuous channel input symbols poses compatibility issues on existing digital communication systems. In this paper, we address these two issues by first investigating the inherent tradeoff between the informativeness of the encoded representations and the robustness to information distortion in the received representations, and then propose a task-oriented communication scheme with digital modulation, named discrete task-oriented JSCC (DT-JSCC), where the transmitter encodes the features into a discrete representation and transmits it to the receiver with the digital modulation scheme. In the DT-JSCC scheme, we develop a robust encoding framework, named robust information bottleneck (RIB), to improve the communication robustness to the channel variations, and derive a tractable variational upper bound of the RIB objective function using the variational approximation to overcome the computational intractability of mutual information. The experimental results demonstrate that the proposed DT-JSCC achieves better inference performance than the baseline methods with low communication latency, and exhibits robustness to channel variations due to the applied RIB framework.

READ FULL TEXT

page 1

page 6

page 7

page 12

research
02/08/2021

Learning Task-Oriented Communication for Edge Inference: An Information Bottleneck Approach

This paper investigates task-oriented communication for edge inference, ...
research
08/11/2022

Learning Based Joint Coding-Modulation for Digital Semantic Communication Systems

In learning-based semantic communications, neural networks have replaced...
research
09/01/2021

Task-Oriented Communication for Multi-Device Cooperative Edge Inference

This paper investigates task-oriented communication for multi-device coo...
research
11/23/2018

Multilevel-Coded Pulse-Position Modulation for Covert Communications over Binary-Input Discrete Memoryless Channels

We develop a low-complexity coding scheme to achieve covert communicatio...
research
11/25/2022

Task-Oriented Communication for Edge Video Analytics

With the development of artificial intelligence (AI) techniques and the ...
research
01/26/2022

Task-Oriented Semantic Communication Systems Based on Extended Rate-Distortion Theory

Considering the performance of intelligent task during signal exchange c...
research
06/08/2022

Robust Semantic Communications with Masked VQ-VAE Enabled Codebook

Although semantic communications have exhibited satisfactory performance...

Please sign up or login with your details

Forgot password? Click here to reset