Communication-Efficient Framework for Distributed Image Semantic Wireless Transmission

08/07/2023
by   Bingyan Xie, et al.
0

Multi-node communication, which refers to the interaction among multiple devices, has attracted lots of attention in many Internet-of-Things (IoT) scenarios. However, its huge amounts of data flows and inflexibility for task extension have triggered the urgent requirement of communication-efficient distributed data transmission frameworks. In this paper, inspired by the great superiorities on bandwidth reduction and task adaptation of semantic communications, we propose a federated learning-based semantic communication (FLSC) framework for multi-task distributed image transmission with IoT devices. Federated learning enables the design of independent semantic communication link of each user while further improves the semantic extraction and task performance through global aggregation. Each link in FLSC is composed of a hierarchical vision transformer (HVT)-based extractor and a task-adaptive translator for coarse-to-fine semantic extraction and meaning translation according to specific tasks. In order to extend the FLSC into more realistic conditions, we design a channel state information-based multiple-input multiple-output transmission module to combat channel fading and noise. Simulation results show that the coarse semantic information can deal with a range of image-level tasks. Moreover, especially in low signal-to-noise ratio and channel bandwidth ratio regimes, FLSC evidently outperforms the traditional scheme, e.g. about 10 peak signal-to-noise ratio gain in the 3 dB channel condition.

READ FULL TEXT

page 1

page 3

page 5

page 6

page 8

page 12

page 13

research
11/25/2018

SparseCast: Hybrid Digital-Analog Wireless Image Transmission Exploiting Frequency Domain Sparsity

A hybrid digital-analog wireless image transmission scheme, called Spars...
research
01/09/2023

A Specific Task-oriented Semantic Image Communication System for substation patrol inspection

Intelligent inspection robots are widely used in substation patrol inspe...
research
02/15/2023

Performance Limits of a Deep Learning-Enabled Text Semantic Communication under Interference

Semantic communication (SemCom) has emerged as a 6G enabler while promis...
research
05/08/2022

Demo: Real-Time Semantic Communications with a Vision Transformer

Semantic communications are expected to enable the more effective delive...
research
04/28/2022

Semantic Communication: An Information Bottleneck View

Motivated by recent success of machine learning tools at the PHY layer a...
research
10/11/2022

Image Segmentation Semantic Communication over Internet of Vehicles

In this paper, the problem of semantic-based efficient image transmissio...
research
05/16/2023

Fusion-Based Multi-User Semantic Communications for Wireless Image Transmission over Degraded Broadcast Channels

Degraded broadcast channels (DBC) are a typical multi-user communication...

Please sign up or login with your details

Forgot password? Click here to reset