Semantic Communications System with Model Division Multiple Access and Controllable Coding Rate for Point Cloud

07/12/2023
by   Xiaoyi Liu, et al.
0

Point cloud, as a 3D representation, is widely used in autonomous driving, virtual reality (VR), and augmented reality (AR). However, traditional communication systems think that the point cloud's semantic information is irrelevant to communication, which hinders the efficient transmission of point clouds in the era of artificial intelligence (AI). This paper proposes a point cloud based semantic communication system (PCSC), which uses AI-based encoding techniques to extract the semantic information of the point cloud and joint source-channel coding (JSCC) technology to overcome the distortion caused by noise channels and solve the "cliff effect" in traditional communication. In addition, the system realizes the controllable coding rate without fine-tuning the network. The method analyzes the coded semantic vector's importance and discards semantically-unimportant information, thereby improving the transmission efficiency. Besides, PCSC and the recently proposed non-orthogonal model division multiple access (MDMA) technology are combined to design a point cloud MDMA transmission system (M-PCSC) for multi-user transmission. Relevant experimental results show that the proposed method outperforms the traditional method 10dB in the same channel bandwidth ratio under the PSNR D1 and PSNR D2 metrics. In terms of transmission, the proposed method can effectively solve the "cliff effect" in the traditional methods.

READ FULL TEXT

page 1

page 7

research
08/04/2022

IPDAE: Improved Patch-Based Deep Autoencoder for Lossy Point Cloud Geometry Compression

Point cloud is a crucial representation of 3D contents, which has been w...
research
05/25/2023

MDVSC – Wireless Model Division Video Semantic Communication

In this paper, we propose a new wireless video communication scheme to a...
research
11/04/2021

A QoE Model in Point Cloud Video Streaming

Point cloud video has been widely used by augmented reality (AR) and vir...
research
06/14/2023

Wireless Point Cloud Transmission

3D point cloud is a three-dimensional data format generated by LiDARs an...
research
03/12/2023

Adaptive Local Adversarial Attacks on 3D Point Clouds for Augmented Reality

As the key technology of augmented reality (AR), 3D recognition and trac...
research
04/26/2021

Points2Sound: From mono to binaural audio using 3D point cloud scenes

Binaural sound that matches the visual counterpart is crucial to bring m...
research
10/14/2022

An Efficient FPGA Accelerator for Point Cloud

Deep learning-based point cloud processing plays an important role in va...

Please sign up or login with your details

Forgot password? Click here to reset