Light Sampling Field and BRDF Representation for Physically-based Neural Rendering

by   Jing Yang, et al.

Physically-based rendering (PBR) is key for immersive rendering effects used widely in the industry to showcase detailed realistic scenes from computer graphics assets. A well-known caveat is that producing the same is computationally heavy and relies on complex capture devices. Inspired by the success in quality and efficiency of recent volumetric neural rendering, we want to develop a physically-based neural shader to eliminate device dependency and significantly boost performance. However, no existing lighting and material models in the current neural rendering approaches can accurately represent the comprehensive lighting models and BRDFs properties required by the PBR process. Thus, this paper proposes a novel lighting representation that models direct and indirect light locally through a light sampling strategy in a learned light sampling field. We also propose BRDF models to separately represent surface/subsurface scattering details to enable complex objects such as translucent material (i.e., skin, jade). We then implement our proposed representations with an end-to-end physically-based neural face skin shader, which takes a standard face asset (i.e., geometry, albedo map, and normal map) and an HDRI for illumination as inputs and generates a photo-realistic rendering as output. Extensive experiments showcase the quality and efficiency of our PBR face skin shader, indicating the effectiveness of our proposed lighting and material representations.


page 4

page 5

page 7

page 8

page 9

page 14

page 15

page 16


NeILF: Neural Incident Light Field for Physically-based Material Estimation

We present a differentiable rendering framework for material and lightin...

ENVIDR: Implicit Differentiable Renderer with Neural Environment Lighting

Recent advances in neural rendering have shown great potential for recon...

Multi-view Inverse Rendering for Large-scale Real-world Indoor Scenes

We present a multi-view inverse rendering method for large-scale real-wo...

PixHt-Lab: Pixel Height Based Light Effect Generation for Image Compositing

Lighting effects such as shadows or reflections are key in making synthe...

Analysis and Compilation of Normal Map Generation Techniques for Pixel Art

Pixel art is a popular artistic style adopted in the gaming industry, an...

Spectral domain decomposition method for physically-based rendering of Royaumont abbey

In the context of a virtual reconstitution of the destroyed Royaumont ab...

BokehMe: When Neural Rendering Meets Classical Rendering

We propose BokehMe, a hybrid bokeh rendering framework that marries a ne...

Please sign up or login with your details

Forgot password? Click here to reset