OctAttention: Octree-based Large-scale Contexts Model for Point Cloud Compression

02/12/2022
by   Chunyang Fu, et al.
0

In point cloud compression, sufficient contexts are significant for modeling the point cloud distribution. However, the contexts gathered by the previous voxel-based methods decrease when handling sparse point clouds. To address this problem, we propose a multiple-contexts deep learning framework called OctAttention employing the octree structure, a memory-efficient representation for point clouds. Our approach encodes octree symbol sequences in a lossless way by gathering the information of sibling and ancestor nodes. Expressly, we first represent point clouds with octree to reduce spatial redundancy, which is robust for point clouds with different resolutions. We then design a conditional entropy model with a large receptive field that models the sibling and ancestor contexts to exploit the strong dependency among the neighboring nodes and employ an attention mechanism to emphasize the correlated nodes in the context. Furthermore, we introduce a mask operation during training and testing to make a trade-off between encoding time and performance. Compared to the previous state-of-the-art works, our approach obtains a 10 gain on the LiDAR benchmark (e.g. SemanticKITTI) and object point cloud dataset (e.g. MPEG 8i, MVUB), and saves 95 baseline. The code is available at https://github.com/zb12138/OctAttention.

READ FULL TEXT

page 1

page 2

page 3

page 4

page 5

page 6

page 7

page 8

research
05/05/2021

VoxelContext-Net: An Octree based Framework for Point Cloud Compression

In this paper, we propose a two-stage deep learning framework called Vox...
research
02/25/2021

A deep perceptual metric for 3D point clouds

Point clouds are essential for storage and transmission of 3D content. A...
research
10/30/2019

LDLS: 3-D Object Segmentation Through Label Diffusion From 2-D Images

Object segmentation in three-dimensional (3-D) point clouds is a critica...
research
06/14/2023

Explore In-Context Learning for 3D Point Cloud Understanding

With the rise of large-scale models trained on broad data, in-context le...
research
12/15/2020

NeuralQAAD: An Efficient Differentiable Framework for High Resolution Point Cloud Compression

In this paper, we propose NeuralQAAD, a differentiable point cloud compr...
research
03/23/2023

Position-Guided Point Cloud Panoptic Segmentation Transformer

DEtection TRansformer (DETR) started a trend that uses a group of learna...
research
12/03/2021

Bridging the Gap: Point Clouds for Merging Neurons in Connectomics

In the field of Connectomics, a primary problem is that of 3D neuron seg...

Please sign up or login with your details

Forgot password? Click here to reset