Wireless Transmission of Images With The Assistance of Multi-level Semantic Information

02/08/2022
by   Zhenguo Zhang, et al.
0

Semantic-oriented communication has been considered as a promising to boost the bandwidth efficiency by only transmitting the semantics of the data. In this paper, we propose a multi-level semantic aware communication system for wireless image transmission, named MLSC-image, which is based on the deep learning techniques and trained in an end to end manner. In particular, the proposed model includes a multilevel semantic feature extractor, that extracts both the highlevel semantic information, such as the text semantics and the segmentation semantics, and the low-level semantic information, such as local spatial details of the images. We employ a pretrained image caption to capture the text semantics and a pretrained image segmentation model to obtain the segmentation semantics. These high-level and low-level semantic features are then combined and encoded by a joint semantic and channel encoder into symbols to transmit over the physical channel. The numerical results validate the effectiveness and efficiency of the proposed semantic communication system, especially under the limited bandwidth condition, which indicates the advantages of the high-level semantics in the compression of images.

READ FULL TEXT
research
05/25/2022

Semantic-preserved Communication System for Highly Efficient Speech Transmission

Deep learning (DL) based semantic communication methods have been explor...
research
10/11/2022

Image Segmentation Semantic Communication over Internet of Vehicles

In this paper, the problem of semantic-based efficient image transmissio...
research
02/07/2022

Semantic-aware Speech to Text Transmission with Redundancy Removal

Deep learning (DL) based semantic communication methods have been explor...
research
01/01/2012

Let us first agree on what the term "semantics" means: An unorthodox approach to an age-old debate

Traditionally, semantics has been seen as a feature of human language. T...
research
03/02/2022

A Split Semantic Detection Algorithm for Psychological Sandplay Image

Psychological sandplay, as an important psychological analysis tool, is ...
research
09/10/2022

Image Restoration under Semantic Communications

Semantic communication has emerged as the breakthrough beyond the Shanno...
research
11/02/2022

Semantic SuperPoint: A Deep Semantic Descriptor

Several SLAM methods benefit from the use of semantic information. Most ...

Please sign up or login with your details

Forgot password? Click here to reset