A Neural Rendering Framework for Free-Viewpoint Relighting

11/26/2019
by   Zhang Chen, et al.
70

We present a novel Relightable Neural Renderer (RNR) for simultaneous view synthesis and relighting using multi-view image inputs. Existing neural rendering (NR) does not explicitly model the physical rendering process and hence has limited capabilities on relighting. RNR instead models image formation in terms of environment lighting, object intrinsic attributes, and the light transport function (LTF), each corresponding to a learnable component. In particular, the incorporation of a physically based rendering process not only enables relighting but also improves the quality of novel view synthesis. Comprehensive experiments on synthetic and real data show that RNR provides a practical and effective solution for conducting free-viewpoint relighting.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 1

page 3

page 6

page 7

page 8

10/14/2021

Appearance Editing with Free-viewpoint Neural Rendering

We present a neural rendering framework for simultaneous view synthesis ...
11/26/2018

IGNOR: Image-guided Neural Object Rendering

We propose a new learning-based novel view synthesis approach for scanne...
05/20/2017

Non-Linear Phase-Shifting of Haar Wavelets for Run-Time All-Frequency Lighting

This paper focuses on real-time all-frequency image-based rendering usin...
07/26/2021

NeLF: Neural Light-transport Field for Portrait View Synthesis and Relighting

Human portraits exhibit various appearances when observed from different...
03/06/2017

Viewpoint Selection for Photographing Architectures

This paper studies the problem of how to choose good viewpoints for taki...
09/20/2021

FreeStyleGAN: Free-view Editable Portrait Rendering with the Camera Manifold

Current Generative Adversarial Networks (GANs) produce photorealistic re...
12/13/2021

HVH: Learning a Hybrid Neural Volumetric Representation for Dynamic Hair Performance Capture

Capturing and rendering life-like hair is particularly challenging due t...

Code Repositories

mvsnerf

Our work presents a novel neural rendering approach that can efficiently reconstruct geometric and neural radiance fields for view synthesis.


view repo

relightable-nr

A Neural Rendering Framework for Free-Viewpoint Relighting (CVPR 2020)


view repo
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.