A Light Stage on Every Desk

05/17/2021
by   Soumyadip Sengupta, et al.
5

Every time you sit in front of a TV or monitor, your face is actively illuminated by time-varying patterns of light. This paper proposes to use this time-varying illumination for synthetic relighting of your face with any new illumination condition. In doing so, we take inspiration from the light stage work of Debevec et al., who first demonstrated the ability to relight people captured in a controlled lighting environment. Whereas existing light stages require expensive, room-scale spherical capture gantries and exist in only a few labs in the world, we demonstrate how to acquire useful data from a normal TV or desktop monitor. Instead of subjecting the user to uncomfortable rapidly flashing light patterns, we operate on images of the user watching a YouTube video or other standard content. We train a deep network on images plus monitor patterns of a given user and learn to predict images of that user under any target illumination (monitor pattern). Experimental evaluation shows that our method produces realistic relighting results. Video results are available at http://grail.cs.washington.edu/projects/Light_Stage_on_Every_Desk/.

READ FULL TEXT

page 6

page 7

page 12

page 15

page 17

page 19

page 20

page 21

01/30/2019

Human-centric light sensing and estimation from RGBD images: The invisible light switch

Lighting design in indoor environments is of primary importance for at l...
12/21/2020

EMLight: Lighting Estimation via Spherical Distribution Approximation

Illumination estimation from a single image is critical in 3D rendering ...
04/08/2022

Dancing under the stars: video denoising in starlight

Imaging in low light is extremely challenging due to low photon counts. ...
04/21/2021

Lighting the Darkness in the Deep Learning Era

Low-light image enhancement (LLIE) aims at improving the perception or i...
05/02/2019

Single Image Portrait Relighting

Lighting plays a central role in conveying the essence and depth of the ...
06/15/2020

A study of the effect of the illumination model on the generation of synthetic training datasets

The use of computer generated images to train Deep Neural Networks is a ...
09/23/2020

Multiplexed Illumination for Classifying Visually Similar Objects

Distinguishing visually similar objects like forged/authentic bills and ...