A Dark Flash Normal Camera

by   Zhihao Xia, et al.

Casual photography is often performed in uncontrolled lighting that can result in low quality images and degrade the performance of downstream processing. We consider the problem of estimating surface normal and reflectance maps of scenes depicting people despite these conditions by supplementing the available visible illumination with a single near infrared (NIR) light source and camera, a so-called "dark flash image". Our method takes as input a single color image captured under arbitrary visible lighting and a single dark flash image captured under controlled front-lit NIR lighting at the same viewpoint, and computes a normal map, a diffuse albedo map, and a specular intensity map of the scene. Since ground truth normal and reflectance maps of faces are difficult to capture, we propose a novel training technique that combines information from two readily available and complementary sources: a stereo depth signal and photometric shading cues. We evaluate our method over a range of subjects and lighting conditions and describe two applications: optimizing stereo geometry and filling the shadows in an image.



There are no comments yet.


page 1

page 3

page 6

page 7

page 8

page 12

page 14

page 15


Lighting, Reflectance and Geometry Estimation from 360^∘ Panoramic Stereo

We propose a method for estimating high-definition spatially-varying lig...

Refining Geometry from Depth Sensors using IR Shading Images

We propose a method to refine geometry of 3D meshes from a consumer leve...

Detailed Surface Geometry and Albedo Recovery from RGB-D Video Under Natural Illumination

In this paper we present a novel approach for depth map enhancement from...

Footprints and Free Space from a Single Color Image

Understanding the shape of a scene from a single color image is a formid...

Single Image Portrait Relighting

Lighting plays a central role in conveying the essence and depth of the ...

Robustly Removing Deep Sea Lighting Effects for Visual Mapping of Abyssal Plains

The majority of Earth's surface lies deep in the oceans, where no surfac...

SPLINE-Net: Sparse Photometric Stereo through Lighting Interpolation and Normal Estimation Networks

This paper solves the Sparse Photometric stereo through Lighting Interpo...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.