Light Direction and Color Estimation from Single Image with Deep Regression

09/18/2020
by   Hassan A. Sial, et al.
0

We present a method to estimate the direction and color of the scene light source from a single image. Our method is based on two main ideas: (a) we use a new synthetic dataset with strong shadow effects with similar constraints to the SID dataset; (b) we define a deep architecture trained on the mentioned dataset to estimate the direction and color of the scene light source. Apart from showing good performance on synthetic images, we additionally propose a preliminary procedure to obtain light positions of the Multi-Illumination dataset, and, in this way, we also prove that our trained model achieves good performance when it is applied to real scenes.

READ FULL TEXT
research
06/14/2020

2D Image Relighting with Image-to-Image Translation

With the advent of Generative Adversarial Networks (GANs), a finer level...
research
06/04/2020

Problems of dataset creation for light source estimation

The paper describes our experience collecting a new dataset for the ligh...
research
08/19/2020

Deep Relighting Networks for Image Light Source Manipulation

Manipulating the light source of given images is an interesting task and...
research
05/02/2023

AutoColor: Learned Light Power Control for Multi-Color Holograms

Multi-color holograms rely on simultaneous illumination from multiple li...
research
11/27/2022

Quantifying spatial, temporal, angular and spectral structure of effective daylight in perceptually meaningful ways

We present a method to capture the 7-dimensional light field structure, ...
research
08/03/2023

Real-time Light Estimation and Neural Soft Shadows for AR Indoor Scenarios

We present a pipeline for realistic embedding of virtual objects into fo...
research
06/03/2020

Scene relighting with illumination estimation in the latent space on an encoder-decoder scheme

The image relighting task of transferring illumination conditions betwee...

Please sign up or login with your details

Forgot password? Click here to reset