Deep Surface Light Fields

10/15/2018
by   Anpei Chen, et al.
0

A surface light field represents the radiance of rays originating from any points on the surface in any directions. Traditional approaches require ultra-dense sampling to ensure the rendering quality. In this paper, we present a novel neural network based technique called deep surface light field or DSLF to use only moderate sampling for high fidelity rendering. DSLF automatically fills in the missing data by leveraging different sampling patterns across the vertices and at the same time eliminates redundancies due to the network's prediction capability. For real data, we address the image registration problem as well as conduct texture-aware remeshing for aligning texture edges with vertices to avoid blurring. Comprehensive experiments show that DSLF can further achieve high data compression ratio while facilitating real-time rendering on the GPU.

READ FULL TEXT

page 2

page 3

page 6

page 8

page 11

page 12

page 13

page 14

research
06/07/2021

DoubleField: Bridging the Neural Surface and Radiance Fields for High-fidelity Human Rendering

We introduce DoubleField, a novel representation combining the merits of...
research
12/19/2022

Real-Time Rendering of Arbitrary Surface Geometries using Learnt Transfer

Precomputed Radiance Transfer (PRT) is widely used for real-time photore...
research
12/18/2019

A Promising Method for Touch-typing Keyboard Rendering

We have developed a novel button click rendering mechanism based on acti...
research
03/26/2018

Semantic See-Through Rendering on Light Fields

We present a novel semantic light field (LF) refocusing technique that c...
research
11/24/2021

Lensless multicore-fiber microendoscope for real-time tailored light field generation with phase encoder neural network (CoreNet)

The generation of tailored light with multi-core fiber (MCF) lensless mi...
research
04/29/2023

NSLF-OL: Online Learning of Neural Surface Light Fields alongside Real-time Incremental 3D Reconstruction

Immersive novel view generation is an important technology in the field ...
research
05/10/2023

Stealth Shaper: Reflectivity Optimization as Surface Stylization

We present a technique to optimize the reflectivity of a surface while p...

Please sign up or login with your details

Forgot password? Click here to reset