A deep perceptual metric for 3D point clouds

02/25/2021
by   Maurice Quach, et al.
0

Point clouds are essential for storage and transmission of 3D content. As they can entail significant volumes of data, point cloud compression is crucial for practical usage. Recently, point cloud geometry compression approaches based on deep neural networks have been explored. In this paper, we evaluate the ability to predict perceptual quality of typical voxel-based loss functions employed to train these networks. We find that the commonly used focal loss and weighted binary cross entropy are poorly correlated with human perception. We thus propose a perceptual loss function for 3D point clouds which outperforms existing loss functions on the ICIP2020 subjective dataset. In addition, we propose a novel truncated distance field voxel grid representation and find that it leads to sparser latent spaces and loss functions that are more correlated with perceived visual quality compared to a binary representation. The source code is available at https://github.com/mauriceqch/2021_pc_perceptual_loss.

READ FULL TEXT
research
02/12/2022

OctAttention: Octree-based Large-scale Contexts Model for Point Cloud Compression

In point cloud compression, sufficient contexts are significant for mode...
research
12/11/2022

Learning Neural Volumetric Field for Point Cloud Geometry Compression

Due to the diverse sparsity, high dimensionality, and large temporal var...
research
09/09/2022

GRASP-Net: Geometric Residual Analysis and Synthesis for Point Cloud Compression

Point cloud compression (PCC) is a key enabler for various 3-D applicati...
research
04/20/2021

Multiscale deep context modeling for lossless point cloud geometry compression

We propose a practical deep generative approach for lossless point cloud...
research
11/10/2021

Theoretical and empirical analysis of a fast algorithm for extracting polygons from signed distance bounds

We investigate an asymptotically fast method for transforming signed dis...
research
03/04/2021

Point Cloud Distortion Quantification based on Potential Energy for Human and Machine Perception

Distortion quantification of point clouds plays a stealth, yet vital rol...
research
06/01/2023

Unleash the Potential of 3D Point Cloud Modeling with A Calibrated Local Geometry-driven Distance Metric

Quantifying the dissimilarity between two unstructured 3D point clouds i...

Please sign up or login with your details

Forgot password? Click here to reset