Single Image Portrait Relighting

05/02/2019
by   Tiancheng Sun, et al.
50

Lighting plays a central role in conveying the essence and depth of the subject in a portrait photograph. Professional photographers will carefully control the lighting in their studio to manipulate the appearance of their subject, while consumer photographers are usually constrained to the illumination of their environment. Though prior works have explored techniques for relighting an image, their utility is usually limited due to requirements of specialized hardware, multiple images of the subject under controlled or known illuminations, or accurate models of geometry and reflectance. To this end, we present a system for portrait relighting: a neural network that takes as input a single RGB image of a portrait taken with a standard cellphone camera in an unconstrained environment, and from that image produces a relit image of that subject as though it were illuminated according to any provided environment map. Our method is trained on a small database of 18 individuals captured under different directional light sources in a controlled light stage setup consisting of a densely sampled sphere of lights. Our proposed technique produces quantitatively superior results on our dataset's validation set compared to prior works, and produces convincing qualitative relighting results on a dataset of hundreds of real-world cellphone portraits. Because our technique can produce a 640 × 640 image in only 160 milliseconds, it may enable interactive user-facing photographic applications in the future.

READ FULL TEXT

page 1

page 2

page 4

page 7

page 8

page 9

page 10

page 11

research
12/11/2020

A Dark Flash Normal Camera

Casual photography is often performed in uncontrolled lighting that can ...
research
04/01/2017

Learning to Predict Indoor Illumination from a Single Image

We propose an automatic method to infer high dynamic range illumination ...
research
07/21/2022

Designing An Illumination-Aware Network for Deep Image Relighting

Lighting is a determining factor in photography that affects the style, ...
research
10/19/2019

Deep Parametric Indoor Lighting Estimation

We present a method to estimate lighting from a single image of an indoo...
research
06/07/2019

Structural Decompositions for End-to-End Relighting

Relighting is an essential step in artificially transferring an object f...
research
01/14/2019

DeepFlash: Turning a Flash Selfie into a Studio Portrait

We present a method for turning a flash selfie taken with a smartphone i...
research
04/20/2020

Complex-Object Visual Inspection via Multiple Lighting Configurations

The design of an automatic visual inspection system is usually performed...

Please sign up or login with your details

Forgot password? Click here to reset