Large AI Model-Based Semantic Communications

07/07/2023
by   Feibo Jiang, et al.
0

Semantic communication (SC) is an emerging intelligent paradigm, offering solutions for various future applications like metaverse, mixed-reality, and the Internet of everything. However, in current SC systems, the construction of the knowledge base (KB) faces several issues, including limited knowledge representation, frequent knowledge updates, and insecure knowledge sharing. Fortunately, the development of the large AI model provides new solutions to overcome above issues. Here, we propose a large AI model-based SC framework (LAM-SC) specifically designed for image data, where we first design the segment anything model (SAM)-based KB (SKB) that can split the original image into different semantic segments by universal semantic knowledge. Then, we present an attention-based semantic integration (ASI) to weigh the semantic segments generated by SKB without human participation and integrate them as the semantic-aware image. Additionally, we propose an adaptive semantic compression (ASC) encoding to remove redundant information in semantic features, thereby reducing communication overhead. Finally, through simulations, we demonstrate the effectiveness of the LAM-SC framework and the significance of the large AI model-based KB development in future SC paradigms.

READ FULL TEXT

page 4

page 6

research
09/03/2023

Large AI Model Empowered Multimodal Semantic Communications

Multimodal signals, including text, audio, image and video, can be integ...
research
09/29/2021

Semantic Communications With AI Tasks

A radical paradigm shift of wireless networks from “connected things” to...
research
09/17/2022

Understand-Before-Talk (UBT): A Semantic Communication Approach to 6G Networks

In Shannon theory, semantic aspects of communication were identified but...
research
07/10/2019

Modeling Semantic Compositionality with Sememe Knowledge

Semantic compositionality (SC) refers to the phenomenon that the meaning...
research
09/04/2023

SemProtector: A Unified Framework for Semantic Protection in Deep Learning-based Semantic Communication Systems

Recently proliferated semantic communications (SC) aim at effectively tr...
research
05/02/2022

A Unified Approach to Semantic Information and Communication based on Probabilistic Logic

Traditionally, studies on technical communication (TC) are based on stoc...
research
09/09/2023

How to Evaluate Semantic Communications for Images with ViTScore Metric?

Semantic communications (SC) have been expected to be a new paradigm shi...

Please sign up or login with your details

Forgot password? Click here to reset