Self-calibrating Deep Photometric Stereo Networks

03/18/2019
by   Guanying Chen, et al.
26

This paper proposes an uncalibrated photometric stereo method for non-Lambertian scenes based on deep learning. Unlike previous approaches that heavily rely on assumptions of specific reflectances and light source distributions, our method is able to determine both shape and light directions of a scene with unknown arbitrary reflectances observed under unknown varying light directions. To achieve this goal, we propose a two-stage deep learning architecture, called SDPS-Net, which can effectively take advantage of intermediate supervision, resulting in reduced learning difficulty compared to a single-stage model. Experiments on both synthetic and real datasets show that our proposed approach significantly outperforms previous uncalibrated photometric stereo methods.

READ FULL TEXT

page 3

page 5

page 7

page 8

07/26/2020

Deep Photometric Stereo for Non-Lambertian Surfaces

This paper addresses the problem of photometric stereo, in both calibrat...
07/11/2022

Edge-preserving Near-light Photometric Stereo with Neural Surfaces

This paper presents a near-light photometric stereo method that faithful...
08/30/2018

CNN-PS: CNN-based Photometric Stereo for General Non-Convex Surfaces

Most conventional photometric stereo algorithms inversely solve a BRDF-b...
07/16/2022

Self-calibrating Photometric Stereo by Neural Inverse Rendering

This paper tackles the task of uncalibrated photometric stereo for 3D ob...
07/23/2018

PS-FCN: A Flexible Learning Framework for Photometric Stereo

This paper addresses the problem of photometric stereo for non-Lambertia...
03/26/2018

Semantic See-Through Rendering on Light Fields

We present a novel semantic light field (LF) refocusing technique that c...
09/12/2020

A CNN Based Approach for the Near-Field Photometric Stereo Problem

Reconstructing the 3D shape of an object using several images under diff...