Wireless 3D Point Cloud Delivery Using Deep Graph Neural Networks

06/17/2020
by   Takuya Fujihashi, et al.
1

In typical point cloud delivery, a sender uses octree-based digital video compression to send three-dimensional (3D) points and color attributes over band-limited links. However, the digital-based schemes have an issue called the cliff effect, where the 3D reconstruction quality will be a step function in terms of wireless channel quality. To prevent the cliff effect subject to channel quality fluctuation, we have proposed soft point cloud delivery called HoloCast. Although the HoloCast realizes graceful quality improvement according to wireless channel quality, it requires large communication overheads. In this paper, we propose a novel scheme for soft point cloud delivery to simultaneously realize better quality and lower communication overheads. The proposed scheme introduces an end-to-end deep learning framework based on graph neural network (GNN) to reconstruct high-quality point clouds from its distorted observation under wireless fading channels. We demonstrate that the proposed GNN-based scheme can reconstruct clean 3D point cloud with low overheads by removing fading and noise effects.

READ FULL TEXT

page 1

page 5

research
03/08/2019

HoloCast: Graph Signal Processing for Graceful Point Cloud Delivery

In conventional point cloud delivery, a sender uses octree-based digital...
research
11/16/2021

Soft Delivery: Survey on A New Paradigm for Wireless and Mobile Multimedia Streaming

The increasing demand for video streaming services is the key driver of ...
research
06/14/2023

Wireless Point Cloud Transmission

3D point cloud is a three-dimensional data format generated by LiDARs an...
research
10/27/2020

Branchy-GNN: a Device-Edge Co-Inference Framework for Efficient Point Cloud Processing

The recent advancements of three-dimensional (3D) data acquisition devic...
research
07/29/2021

Video-based Point Cloud Compression Artifact Removal

Photo-realistic point cloud capture and transmission are the fundamental...
research
10/13/2019

DeepPCO: End-to-End Point Cloud Odometry through Deep Parallel Neural Network

Odometry is of key importance for localization in the absence of a map. ...
research
08/13/2021

Towards Efficient Point Cloud Graph Neural Networks Through Architectural Simplification

In recent years graph neural network (GNN)-based approaches have become ...

Please sign up or login with your details

Forgot password? Click here to reset