Joint Task and Data Oriented Semantic Communications: A Deep Separate Source-channel Coding Scheme

02/27/2023
by   Jianhao Huang, et al.
0

Semantic communications are expected to accomplish various semantic tasks with relatively less spectrum resource by exploiting the semantic feature of source data. To simultaneously serve both the data transmission and semantic tasks, joint data compression and semantic analysis has become pivotal issue in semantic communications. This paper proposes a deep separate source-channel coding (DSSCC) framework for the joint task and data oriented semantic communications (JTD-SC) and utilizes the variational autoencoder approach to solve the rate-distortion problem with semantic distortion. First, by analyzing the Bayesian model of the DSSCC framework, we derive a novel rate-distortion optimization problem via the Bayesian inference approach for general data distributions and semantic tasks. Next, for a typical application of joint image transmission and classification, we combine the variational autoencoder approach with a forward adaption scheme to effectively extract image features and adaptively learn the density information of the obtained features. Finally, an iterative training algorithm is proposed to tackle the overfitting issue of deep learning models. Simulation results reveal that the proposed scheme achieves better coding gain as well as data recovery and classification performance in most scenarios, compared to the classical compression schemes and the emerging deep joint source-channel schemes.

READ FULL TEXT

page 1

page 3

page 7

page 8

page 9

page 10

page 12

page 14

research
12/21/2021

Nonlinear Transform Source-Channel Coding for Semantic Communications

In this paper, we propose a new class of high-efficient deep joint sourc...
research
04/05/2023

Semantic Communications for Image Recovery and Classification via Deep Joint Source and Channel Coding

With the recent advancements in edge artificial intelligence (AI), futur...
research
08/22/2023

Semantic Multi-Resolution Communications

Deep learning based joint source-channel coding (JSCC) has demonstrated ...
research
08/19/2022

Deep Joint Source-Channel and Encryption Coding: Secure Semantic Communications

Deep learning driven joint source-channel coding (JSCC) for wireless ima...
research
11/08/2022

Adaptive Semantic Communications: Overfitting the Source and Channel for Profit

Most semantic communication systems leverage deep learning models to pro...
research
02/08/2021

Learning Task-Oriented Communication for Edge Inference: An Information Bottleneck Approach

This paper investigates task-oriented communication for edge inference, ...
research
03/26/2023

Improved Nonlinear Transform Source-Channel Coding to Catalyze Semantic Communications

Recent deep learning methods have led to increased interest in solving h...

Please sign up or login with your details

Forgot password? Click here to reset