Controllable Light Diffusion for Portraits

05/08/2023
by   David Futschik, et al.
0

We introduce light diffusion, a novel method to improve lighting in portraits, softening harsh shadows and specular highlights while preserving overall scene illumination. Inspired by professional photographers' diffusers and scrims, our method softens lighting given only a single portrait photo. Previous portrait relighting approaches focus on changing the entire lighting environment, removing shadows (ignoring strong specular highlights), or removing shading entirely. In contrast, we propose a learning based method that allows us to control the amount of light diffusion and apply it on in-the-wild portraits. Additionally, we design a method to synthetically generate plausible external shadows with sub-surface scattering effects while conforming to the shape of the subject's face. Finally, we show how our approach can increase the robustness of higher level vision applications, such as albedo estimation, geometry estimation and semantic segmentation.

READ FULL TEXT

page 1

page 2

page 3

page 4

page 5

page 6

page 7

page 8

research
04/19/2023

DiFaReli: Diffusion Face Relighting

We present a novel approach to single-view face relighting in the wild. ...
research
03/16/2018

Faces as Lighting Probes via Unsupervised Deep Highlight Extraction

We present a method for estimating detailed scene illumination using hum...
research
04/20/2021

Lighting, Reflectance and Geometry Estimation from 360^∘ Panoramic Stereo

We propose a method for estimating high-definition spatially-varying lig...
research
10/01/2021

Robustly Removing Deep Sea Lighting Effects for Visual Mapping of Abyssal Plains

The majority of Earth's surface lies deep in the oceans, where no surfac...
research
04/26/2023

EverLight: Indoor-Outdoor Editable HDR Lighting Estimation

Because of the diversity in lighting environments, existing illumination...
research
08/13/2023

CLE Diffusion: Controllable Light Enhancement Diffusion Model

Low light enhancement has gained increasing importance with the rapid de...
research
01/13/2021

Random Shadows and Highlights: A new data augmentation method for extreme lighting conditions

In this paper, we propose a new data augmentation method, Random Shadows...

Please sign up or login with your details

Forgot password? Click here to reset