Self-calibrating Deep Photometric Stereo Networks

by   Guanying Chen, et al.

This paper proposes an uncalibrated photometric stereo method for non-Lambertian scenes based on deep learning. Unlike previous approaches that heavily rely on assumptions of specific reflectances and light source distributions, our method is able to determine both shape and light directions of a scene with unknown arbitrary reflectances observed under unknown varying light directions. To achieve this goal, we propose a two-stage deep learning architecture, called SDPS-Net, which can effectively take advantage of intermediate supervision, resulting in reduced learning difficulty compared to a single-stage model. Experiments on both synthetic and real datasets show that our proposed approach significantly outperforms previous uncalibrated photometric stereo methods.


page 3

page 5

page 7

page 8


Deep Photometric Stereo for Non-Lambertian Surfaces

This paper addresses the problem of photometric stereo, in both calibrat...

Edge-preserving Near-light Photometric Stereo with Neural Surfaces

This paper presents a near-light photometric stereo method that faithful...

CNN-PS: CNN-based Photometric Stereo for General Non-Convex Surfaces

Most conventional photometric stereo algorithms inversely solve a BRDF-b...

Self-calibrating Photometric Stereo by Neural Inverse Rendering

This paper tackles the task of uncalibrated photometric stereo for 3D ob...

PS-FCN: A Flexible Learning Framework for Photometric Stereo

This paper addresses the problem of photometric stereo for non-Lambertia...

Semantic See-Through Rendering on Light Fields

We present a novel semantic light field (LF) refocusing technique that c...

A CNN Based Approach for the Near-Field Photometric Stereo Problem

Reconstructing the 3D shape of an object using several images under diff...