TRANSPR: Transparency Ray-Accumulating Neural 3D Scene Point Renderer

09/06/2020
by   Maria Kolos, et al.
1

We propose and evaluate a neural point-based graphics method that can model semi-transparent scene parts. Similarly to its predecessor pipeline, ours uses point clouds to model proxy geometry, and augments each point with a neural descriptor. Additionally, a learnable transparency value is introduced in our approach for each point. Our neural rendering procedure consists of two steps. Firstly, the point cloud is rasterized using ray grouping into a multi-channel image. This is followed by the neural rendering step that "translates" the rasterized image into an RGB output using a learnable convolutional network. New scenes can be modeled using gradient-based optimization of neural descriptors and of the rendering network. We show that novel views of semi-transparent point cloud scenes can be generated after training with our approach. Our experiments demonstrate the benefit of introducing semi-transparency into the neural point-based modeling for a range of scenes with semi-transparent parts.

READ FULL TEXT

page 1

page 4

page 6

page 7

page 9

page 10

research
06/19/2019

Neural Point-Based Graphics

We present a new point-based approach for modeling complex scenes. The a...
research
11/12/2018

Deep-learning the Latent Space of Light Transport

We suggest a method to directly deep-learn light transport, i. e., the m...
research
03/24/2022

NPBG++: Accelerating Neural Point-Based Graphics

We present a new system (NPBG++) for the novel view synthesis (NVS) task...
research
05/17/2023

Deep and Fast Approximate Order Independent Transparency

We present a machine learning approach for efficiently computing order i...
research
01/13/2022

Stereo Magnification with Multi-Layer Images

Representing scenes with multiple semi-transparent colored layers has be...
research
10/06/2020

Scalable Rendering of Variable Density Point Cloud Data

In this paper, we present a novel proxy-based method of the adaptive hap...
research
06/15/2023

Enhancing Neural Rendering Methods with Image Augmentations

Faithfully reconstructing 3D geometry and generating novel views of scen...

Please sign up or login with your details

Forgot password? Click here to reset