EMLight: Lighting Estimation via Spherical Distribution Approximation

12/21/2020
by   Fangneng Zhan, et al.
18

Illumination estimation from a single image is critical in 3D rendering and it has been investigated extensively in the computer vision and computer graphic research community. On the other hand, existing works estimate illumination by either regressing light parameters or generating illumination maps that are often hard to optimize or tend to produce inaccurate predictions. We propose Earth Mover Light (EMLight), an illumination estimation framework that leverages a regression network and a neural projector for accurate illumination estimation. We decompose the illumination map into spherical light distribution, light intensity and the ambient term, and define the illumination estimation as a parameter regression task for the three illumination components. Motivated by the Earth Mover distance, we design a novel spherical mover's loss that guides to regress light distribution parameters accurately by taking advantage of the subtleties of spherical distribution. Under the guidance of the predicted spherical distribution, light intensity and ambient term, the neural projector synthesizes panoramic illumination maps with realistic light frequency. Extensive experiments show that EMLight achieves accurate illumination estimation and the generated relighting in 3D object embedding exhibits superior plausibility and fidelity as compared with state-of-the-art methods.

READ FULL TEXT

page 1

page 3

page 4

page 5

page 6

02/20/2021

GMLight: Lighting Estimation via Geometric Distribution Approximation

Lighting estimation from a single image is an essential yet challenging ...
06/24/2021

Sparse Needlets for Lighting Estimation with Spherical Transport Loss

Accurate lighting estimation is challenging yet critical to many compute...
05/17/2021

A Light Stage on Every Desk

Every time you sit in front of a TV or monitor, your face is actively il...
01/05/2022

Harmonics Virtual Lights : fast projection of luminance field on spherical harmonics for efficient rendering

In this paper, we introduce Harmonics Virtual Lights (HVL), to model ind...
08/02/2019

Effects of Illumination on the Categorization of Shiny Materials

The present research was designed to examine how patterns of illuminatio...
06/16/2019

STAR: A Structure and Texture Aware Retinex Model

Retinex theory is developed mainly to decompose an image into the illumi...
12/18/2019

Ambient Lighting Generation for Flash Images with Guided Conditional Adversarial Networks

To cope with the challenges that low light conditions produce in images,...