Wireless End-to-End Image Transmission System using Semantic Communications

02/27/2023
by   Maheshi Lokumarambage, et al.
0

Semantic communication is considered the future of mobile communication, which aims to transmit data beyond Shannon's theorem of communications by transmitting the semantic meaning of the data rather than the bit-by-bit reconstruction of the data at the receiver's end. The semantic communication paradigm aims to bridge the gap of limited bandwidth problems in modern high-volume multimedia application content transmission. Integrating AI technologies with the 6G communications networks paved the way to develop semantic communication-based end-to-end communication systems. In this study, we have implemented a semantic communication-based end-to-end image transmission system, and we discuss potential design considerations in developing semantic communication systems in conjunction with physical channel characteristics. A Pre-trained GAN network is used at the receiver as the transmission task to reconstruct the realistic image based on the Semantic segmented image at the receiver input. The semantic segmentation task at the transmitter (encoder) and the GAN network at the receiver (decoder) is trained on a common knowledge base, the COCO-Stuff dataset. The research shows that the resource gain in the form of bandwidth saving is immense when transmitting the semantic segmentation map through the physical channel instead of the ground truth image in contrast to conventional communication systems. Furthermore, the research studies the effect of physical channel distortions and quantization noise on semantic communication-based multimedia content transmission.

READ FULL TEXT

page 18

page 19

page 20

page 21

page 22

research
02/07/2022

Robust Semantic Communications Against Semantic Noise

Although the semantic communications have exhibited satisfactory perform...
research
05/18/2023

Rate-Adaptive Coding Mechanism for Semantic Communications With Multi-Modal Data

Recently, the ever-increasing demand for bandwidth in multi-modal commun...
research
04/26/2023

Automatic and Flexible Transmission of Semantic Map Images using Polar Codes for End-to-End Semantic-based Communication Systems

Semantic communication represents a promising roadmap toward achieving e...
research
01/28/2023

Knowledge-Aware Semantic Communication System Design

The recent emergence of 6G raises the challenge of increasing the transm...
research
12/30/2022

Knowledge-Aware Semantic Communication System Design and Data Allocation

The recent emergence of 6G raises the challenge of increasing the transm...
research
06/08/2022

Robust Semantic Communications with Masked VQ-VAE Enabled Codebook

Although semantic communications have exhibited satisfactory performance...
research
11/17/2022

Learning to Communicate with Intent: An Introduction

We propose a novel framework to learn how to communicate with intent, i....

Please sign up or login with your details

Forgot password? Click here to reset