LM-GAN: A Photorealistic All-Weather Parametric Sky Model

01/31/2023
by   Lucas Valença, et al.
0

We present LM-GAN, an HDR sky model that generates photorealistic environment maps with weathered skies. Our sky model retains the flexibility of traditional parametric models and enables the reproduction of photorealistic all-weather skies with visual diversity in cloud formations. This is achieved with flexible and intuitive user controls for parameters, including sun position, sky color, and atmospheric turbidity. Our method is trained directly from inputs fitted to real HDR skies, learning both to preserve the input's illumination and correlate it to the real reference's atmospheric components in an end-to-end manner. Our main contributions are a generative model trained on both sky appearance and scene rendering losses, as well as a novel sky-parameter fitting algorithm. We demonstrate that our fitting algorithm surpasses existing approaches in both accuracy and sky fidelity, and also provide quantitative and qualitative analyses, demonstrating LM-GAN's ability to match parametric input to photorealistic all-weather skies. The generated HDR environment maps are ready to use in 3D rendering engines and can be applied to a wide range of image-based lighting applications.

READ FULL TEXT

page 1

page 5

page 7

research
06/12/2019

All-Weather Deep Outdoor Lighting Estimation

We present a neural network that predicts HDR outdoor illumination from ...
research
06/02/2023

Adjustable Visual Appearance for Generalizable Novel View Synthesis

We present a generalizable novel view synthesis method where it is possi...
research
04/26/2023

EverLight: Indoor-Outdoor Editable HDR Lighting Estimation

Because of the diversity in lighting environments, existing illumination...
research
11/30/2022

SinGRAF: Learning a 3D Generative Radiance Field for a Single Scene

Generative models have shown great promise in synthesizing photorealisti...
research
06/18/2020

Neural Graphics Pipeline for Controllable Image Generation

We present Neural Graphics Pipeline (NGP), a hybrid generative model tha...
research
04/20/2018

An Approximate Shading Model with Detail Decomposition for Object Relighting

We present an object relighting system that allows an artist to select a...

Please sign up or login with your details

Forgot password? Click here to reset