All-Weather Deep Outdoor Lighting Estimation

06/12/2019
by   Jinsong Zhang, et al.
5

We present a neural network that predicts HDR outdoor illumination from a single LDR image. At the heart of our work is a method to accurately learn HDR lighting from LDR panoramas under any weather condition. We achieve this by training another CNN (on a combination of synthetic and real images) to take as input an LDR panorama, and regress the parameters of the Lalonde-Matthews outdoor illumination model. This model is trained such that it a) reconstructs the appearance of the sky, and b) renders the appearance of objects lit by this illumination. We use this network to label a large-scale dataset of LDR panoramas with lighting parameters and use them to train our single image outdoor lighting estimation network. We demonstrate, via extensive experiments, that both our panorama and single image networks outperform the state of the art, and unlike prior work, are able to handle weather conditions ranging from fully sunny to overcast skies.

READ FULL TEXT

page 1

page 4

page 6

page 7

page 8

research
05/10/2019

Deep Sky Modeling for Single Image Outdoor Lighting Estimation

We propose a data-driven learned sky model, which we use for outdoor lig...
research
10/17/2019

A Dataset of Multi-Illumination Images in the Wild

Collections of images under a single, uncontrolled illumination have ena...
research
02/18/2022

Spatio-Temporal Outdoor Lighting Aggregation on Image Sequences using Transformer Networks

In this work, we focus on outdoor lighting estimation by aggregating ind...
research
01/31/2023

LM-GAN: A Photorealistic All-Weather Parametric Sky Model

We present LM-GAN, an HDR sky model that generates photorealistic enviro...
research
11/27/2018

Reconstruction Loss Minimized FCN for Single Image Dehazing

Haze and fog reduce the visibility of outdoor scenes as a veil like semi...
research
04/18/2023

Deep Dynamic Cloud Lighting

Sky illumination is a core source of lighting in rendering, and a substa...
research
05/31/2023

Automatic Illumination Spectrum Recovery

We develop a deep learning network to estimate the illumination spectrum...

Please sign up or login with your details

Forgot password? Click here to reset