Point Cloud Distortion Quantification based on Potential Energy for Human and Machine Perception

03/04/2021
by   Qi Yang, et al.
10

Distortion quantification of point clouds plays a stealth, yet vital role in a wide range of human and machine perception tasks. For human perception tasks, a distortion quantification can substitute subjective experiments to guide 3D visualization; while for machine perception tasks, a distortion quantification can work as a loss function to guide the training of deep neural networks for unsupervised learning tasks. To handle a variety of demands in many applications, a distortion quantification needs to be distortion discriminable, differentiable, and have a low computational complexity. Currently, however, there is a lack of a general distortion quantification that can satisfy all three conditions. To fill this gap, this work proposes multiscale potential energy discrepancy (MPED), a distortion quantification to measure point cloud geometry and color difference. By evaluating at various neighborhood sizes, the proposed MPED achieves global-local tradeoffs, capturing distortion in a multiscale fashion. Extensive experimental studies validate MPED's superiority for both human and machine perception tasks.

READ FULL TEXT

page 2

page 8

page 10

research
02/25/2020

Rate Distortion Optimized Joint Bit Allocation between Geometry and Color for Video-based 3D Point Cloud Compression

Rate distortion optimization plays a very important role in image/video ...
research
11/19/2022

Rate-Distortion Modeling for Bit Rate Constrained Point Cloud Compression

As being one of the main representation formats of 3D real world and wel...
research
02/25/2020

Model-based Joint Bit Allocation between Geometry and Color for Video-based 3D Point Cloud Compression

Rate distortion optimization plays a very important role in image/video ...
research
10/10/2022

Evaluating Point Cloud Quality via Transformational Complexity

Full-reference point cloud quality assessment (FR-PCQA) aims to infer th...
research
02/25/2021

A deep perceptual metric for 3D point clouds

Point clouds are essential for storage and transmission of 3D content. A...
research
03/03/2021

A Bounded Measure for Estimating the Benefit of Visualization: Case Studies and Empirical Evaluation

Many visual representations, such as volume-rendered images and metro ma...
research
01/22/2017

Perception-based energy functions in seam-cutting

Image stitching is challenging in consumer-level photography, due to ali...

Please sign up or login with your details

Forgot password? Click here to reset