PUFA-GAN: A Frequency-Aware Generative Adversarial Network for 3D Point Cloud Upsampling

03/02/2022
by   Hao Liu, et al.
4

We propose a generative adversarial network for point cloud upsampling, which can not only make the upsampled points evenly distributed on the underlying surface but also efficiently generate clean high frequency regions. The generator of our network includes a dynamic graph hierarchical residual aggregation unit and a hierarchical residual aggregation unit for point feature extraction and upsampling, respectively. The former extracts multiscale point-wise descriptive features, while the latter captures rich feature details with hierarchical residuals. To generate neat edges, our discriminator uses a graph filter to extract and retain high frequency points. The generated high resolution point cloud and corresponding high frequency points help the discriminator learn the global and high frequency properties of the point cloud. We also propose an identity distribution loss function to make sure that the upsampled points remain on the underlying surface of the input low resolution point cloud. To assess the regularity of the upsampled points in high frequency regions, we introduce two evaluation metrics. Objective and subjective results demonstrate that the visual quality of the upsampled point clouds generated by our method is better than that of the state-of-the-art methods.

READ FULL TEXT

page 1

page 2

page 3

page 5

page 8

page 10

research
07/25/2019

PU-GAN: a Point Cloud Upsampling Adversarial Network

Point clouds acquired from range scans are often sparse, noisy, and non-...
research
05/03/2022

Frequency-Selective Geometry Upsampling of Point Clouds

The demand for high-resolution point clouds has increased throughout the...
research
08/06/2019

Point Cloud Super Resolution with Adversarial Residual Graph Networks

Point cloud super-resolution is a fundamental problem for 3D reconstruct...
research
09/06/2022

Wavelet-based Loss for High-frequency Interface Dynamics

Generating highly detailed, complex data is a long-standing and frequent...
research
01/21/2018

PU-Net: Point Cloud Upsampling Network

Learning and analyzing 3D point cloud with deep networks is challenging ...
research
10/26/2022

Xiaoicesing 2: A High-Fidelity Singing Voice Synthesizer Based on Generative Adversarial Network

XiaoiceSing is a singing voice synthesis (SVS) system that aims at gener...
research
10/07/2022

Multi-Frequency-Aware Patch Adversarial Learning for Neural Point Cloud Rendering

We present a neural point cloud rendering pipeline through a novel multi...

Please sign up or login with your details

Forgot password? Click here to reset