Frequency-Modulated Point Cloud Rendering with Easy Editing

03/14/2023
by   Yi Zhang, et al.
0

We develop an effective point cloud rendering pipeline for novel view synthesis, which enables high fidelity local detail reconstruction, real-time rendering and user-friendly editing. In the heart of our pipeline is an adaptive frequency modulation module called Adaptive Frequency Net (AFNet), which utilizes a hypernetwork to learn the local texture frequency encoding that is consecutively injected into adaptive frequency activation layers to modulate the implicit radiance signal. This mechanism improves the frequency expressive ability of the network with richer frequency basis support, only at a small computational budget. To further boost performance, a preprocessing module is also proposed for point cloud geometry optimization via point opacity estimation. In contrast to implicit rendering, our pipeline supports high-fidelity interactive editing based on point cloud manipulation. Extensive experimental results on NeRF-Synthetic, ScanNet, DTU and Tanks and Temples datasets demonstrate the superior performances achieved by our method in terms of PSNR, SSIM and LPIPS, in comparison to the state-of-the-art.

READ FULL TEXT

page 1

page 6

page 8

page 13

page 14

page 15

page 16

page 17

research
07/07/2021

Rotation Transformation Network: Learning View-Invariant Point Cloud for Classification and Segmentation

Many recent works show that a spatial manipulation module could boost th...
research
05/04/2023

NeuralEditor: Editing Neural Radiance Fields via Manipulating Point Clouds

This paper proposes NeuralEditor that enables neural radiance fields (Ne...
research
02/10/2023

FastPoints: A State-of-the-Art Point Cloud Renderer for Unity

In this paper, we introduce FastPoints, a state-of-the-art point cloud r...
research
09/12/2022

Learning A Unified 3D Point Cloud for View Synthesis

3D point cloud representation-based view synthesis methods have demonstr...
research
04/15/2020

Intuitive, Interactive Beard and Hair Synthesis with Generative Models

We present an interactive approach to synthesizing realistic variations ...
research
07/20/2023

PAPR: Proximity Attention Point Rendering

Learning accurate and parsimonious point cloud representations of scene ...
research
10/06/2020

Scalable Rendering of Variable Density Point Cloud Data

In this paper, we present a novel proxy-based method of the adaptive hap...

Please sign up or login with your details

Forgot password? Click here to reset