A Neural Rendering Framework for Free-Viewpoint Relighting

11/26/2019
by   Zhang Chen, et al.
70

We present a novel Relightable Neural Renderer (RNR) for simultaneous view synthesis and relighting using multi-view image inputs. Existing neural rendering (NR) does not explicitly model the physical rendering process and hence has limited capabilities on relighting. RNR instead models image formation in terms of environment lighting, object intrinsic attributes, and the light transport function (LTF), each corresponding to a learnable component. In particular, the incorporation of a physically based rendering process not only enables relighting but also improves the quality of novel view synthesis. Comprehensive experiments on synthetic and real data show that RNR provides a practical and effective solution for conducting free-viewpoint relighting.

READ FULL TEXT

page 1

page 3

page 6

page 7

page 8

research
10/14/2021

Appearance Editing with Free-viewpoint Neural Rendering

We present a neural rendering framework for simultaneous view synthesis ...
research
08/24/2023

Improving NeRF Quality by Progressive Camera Placement for Unrestricted Navigation in Complex Environments

Neural Radiance Fields, or NeRFs, have drastically improved novel view s...
research
11/26/2018

IGNOR: Image-guided Neural Object Rendering

We propose a new learning-based novel view synthesis approach for scanne...
research
05/05/2022

Neural Rendering in a Room: Amodal 3D Understanding and Free-Viewpoint Rendering for the Closed Scene Composed of Pre-Captured Objects

We, as human beings, can understand and picture a familiar scene from ar...
research
12/15/2022

SteerNeRF: Accelerating NeRF Rendering via Smooth Viewpoint Trajectory

Neural Radiance Fields (NeRF) have demonstrated superior novel view synt...
research
05/20/2017

Non-Linear Phase-Shifting of Haar Wavelets for Run-Time All-Frequency Lighting

This paper focuses on real-time all-frequency image-based rendering usin...
research
03/06/2017

Viewpoint Selection for Photographing Architectures

This paper studies the problem of how to choose good viewpoints for taki...

Please sign up or login with your details

Forgot password? Click here to reset