Real-Time Rendering of Arbitrary Surface Geometries using Learnt Transfer

12/19/2022
by   Sirikonda Dhawal, et al.
0

Precomputed Radiance Transfer (PRT) is widely used for real-time photorealistic effects. PRT disentangles the rendering equation into transfer and lighting, enabling their precomputation. Transfer accounts for the cosine-weighted visibility of points in the scene while lighting for emitted radiance from the environment. Prior art stored precomputed transfer in a tabulated manner, either in vertex or texture space. These values are fetched with interpolation at each point for shading. Vertex space methods require densely tessellated mesh vertices for high quality images. Texture space methods require non-overlapping and area-preserving UV mapping to be available. They also require a high-resolution texture to avoid rendering artifacts. In this paper, we propose a compact transfer representation that is learnt directly on scene geometry points. Specifically, we train a small multi-layer perceptron (MLP) to predict the transfer at sampled surface points. Our approach is most beneficial where inherent mesh storage structure and natural UV mapping are not available, such as Implicit Surfaces as it learns the transfer values directly on the surface. We demonstrate real-time, photorealistic renderings of diffuse and glossy materials on SDF geometries with PRT using our approach.

READ FULL TEXT

page 1

page 4

page 5

page 6

page 7

page 8

research
03/23/2022

PRTT: Precomputed Radiance Transfer Textures

Precomputed Radiance Transfer (PRT) can achieve high quality renders of ...
research
03/01/2021

NeuTex: Neural Texture Mapping for Volumetric Neural Rendering

Recent work has demonstrated that volumetric scene representations combi...
research
10/15/2018

Deep Surface Light Fields

A surface light field represents the radiance of rays originating from a...
research
11/30/2020

Vehicle Reconstruction and Texture Estimation Using Deep Implicit Semantic Template Mapping

We introduce VERTEX, an effective solution to recover 3D shape and intri...
research
05/09/2023

Stochastic Texture Filtering

2D texture maps and 3D voxel arrays are widely used to add rich detail t...
research
06/10/2022

EigenFairing: 3D Model Fairing using Image Coherence

A surface is often modeled as a triangulated mesh of 3D points and textu...
research
06/15/2020

Iterative Nadaraya-Watson Distribution Transfer for Colour Grading

We propose a new method with Nadaraya-Watson that maps one N-dimensional...

Please sign up or login with your details

Forgot password? Click here to reset