A Dark Flash Normal Camera

12/11/2020
by   Zhihao Xia, et al.
0

Casual photography is often performed in uncontrolled lighting that can result in low quality images and degrade the performance of downstream processing. We consider the problem of estimating surface normal and reflectance maps of scenes depicting people despite these conditions by supplementing the available visible illumination with a single near infrared (NIR) light source and camera, a so-called "dark flash image". Our method takes as input a single color image captured under arbitrary visible lighting and a single dark flash image captured under controlled front-lit NIR lighting at the same viewpoint, and computes a normal map, a diffuse albedo map, and a specular intensity map of the scene. Since ground truth normal and reflectance maps of faces are difficult to capture, we propose a novel training technique that combines information from two readily available and complementary sources: a stereo depth signal and photometric shading cues. We evaluate our method over a range of subjects and lighting conditions and describe two applications: optimizing stereo geometry and filling the shadows in an image.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 1

page 3

page 6

page 7

page 8

page 12

page 14

page 15

04/20/2021

Lighting, Reflectance and Geometry Estimation from 360^∘ Panoramic Stereo

We propose a method for estimating high-definition spatially-varying lig...
08/18/2016

Refining Geometry from Depth Sensors using IR Shading Images

We propose a method to refine geometry of 3D meshes from a consumer leve...
02/06/2017

Detailed Surface Geometry and Albedo Recovery from RGB-D Video Under Natural Illumination

In this paper we present a novel approach for depth map enhancement from...
04/14/2020

Footprints and Free Space from a Single Color Image

Understanding the shape of a scene from a single color image is a formid...
05/02/2019

Single Image Portrait Relighting

Lighting plays a central role in conveying the essence and depth of the ...
10/01/2021

Robustly Removing Deep Sea Lighting Effects for Visual Mapping of Abyssal Plains

The majority of Earth's surface lies deep in the oceans, where no surfac...
05/10/2019

SPLINE-Net: Sparse Photometric Stereo through Lighting Interpolation and Normal Estimation Networks

This paper solves the Sparse Photometric stereo through Lighting Interpo...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.