Enabling the Wireless Metaverse via Semantic Multiverse Communication

12/13/2022
by   Jihong Park, et al.
0

Metaverse over wireless networks is an emerging use case of the sixth generation (6G) wireless systems, posing unprecedented challenges in terms of its multi-modal data transmissions with stringent latency and reliability requirements. Towards enabling this wireless metaverse, in this article we propose a novel semantic communication (SC) framework by decomposing the metaverse into human/machine agent-specific semantic multiverses (SMs). An SM stored at each agent comprises a semantic encoder and a generator, leveraging recent advances in generative artificial intelligence (AI). To improve communication efficiency, the encoder learns the semantic representations (SRs) of multi-modal data, while the generator learns how to manipulate them for locally rendering scenes and interactions in the metaverse. Since these learned SMs are biased towards local environments, their success hinges on synchronizing heterogeneous SMs in the background while communicating SRs in the foreground, turning the wireless metaverse problem into the problem of semantic multiverse communication (SMC). Based on this SMC architecture, we propose several promising algorithmic and analytic tools for modeling and designing SMC, ranging from distributed learning and multi-agent reinforcement learning (MARL) to signaling games and symbolic AI.

READ FULL TEXT

page 1

page 4

page 6

research
07/06/2023

Wireless Multi-Agent Generative AI: From Connected Intelligence to Collective Intelligence

The convergence of generative large language models (LLMs), edge network...
research
09/29/2021

Semantic Communications With AI Tasks

A radical paradigm shift of wireless networks from “connected things” to...
research
04/25/2023

Causal Semantic Communication for Digital Twins: A Generalizable Imitation Learning Approach

A digital twin (DT) leverages a virtual representation of the physical w...
research
05/22/2022

Neuro-Symbolic Artificial Intelligence (AI) for Intent based Semantic Communication

Intent-based networks that integrate sophisticated machine reasoning tec...
research
04/21/2023

Generative AI-enabled Vehicular Networks: Fundamentals, Framework, and Case Study

Recognizing the tremendous improvements that the integration of generati...
research
10/21/2022

Neuro-Symbolic Causal Reasoning Meets Signaling Game for Emergent Semantic Communications

Semantic communication (SC) aims to communicate reliably with minimal da...
research
09/05/2023

Generative AI-aided Joint Training-free Secure Semantic Communications via Multi-modal Prompts

Semantic communication (SemCom) holds promise for reducing network resou...

Please sign up or login with your details

Forgot password? Click here to reset