Variational Uncalibrated Photometric Stereo under General Lighting

04/08/2019
by   Bjoern Haefner, et al.
0

Photometric stereo (PS) techniques nowadays remain constrained to an ideal laboratory setup where modeling and calibration of lighting is amenable. This work aims to eliminate such restrictions. To this end, we introduce an efficient principled variational approach to uncalibrated PS under general illumination, which is approximated through a second-order spherical harmonic expansion. The joint recovery of shape, reflectance and illumination is formulated as a variational problem where shape estimation is carried out directly in terms of the underlying perspective depth map, thus implicitly ensuring integrability and bypassing the need for a subsequent normal integration. We provide a tailored numerical scheme to solve the resulting nonconvex problem efficiently and robustly. On a variety of evaluations, our method consistently reduces the mean angular error by a factor of 2-3 compared to the state-of-the-art.

READ FULL TEXT

page 1

page 3

page 7

page 8

page 10

page 11

page 12

research
09/29/2017

A Variational Approach to Shape-from-shading Under Natural Illumination

A numerical solution to shape-from-shading under natural illumination is...
research
11/17/2019

On the well-posedness of uncalibrated photometric stereo under general lighting

Uncalibrated photometric stereo aims at estimating the 3D-shape of a sur...
research
06/24/2021

Sparse Needlets for Lighting Estimation with Spherical Transport Loss

Accurate lighting estimation is challenging yet critical to many compute...
research
06/06/2022

Universal Photometric Stereo Network using Global Lighting Contexts

This paper tackles a new photometric stereo task, named universal photom...
research
05/10/2019

SPLINE-Net: Sparse Photometric Stereo through Lighting Interpolation and Normal Estimation Networks

This paper solves the Sparse Photometric stereo through Lighting Interpo...
research
09/29/2017

Optimisation of photometric stereo methods by non-convex variational minimisation

Estimating shape and appearance of a three dimensional object from a giv...
research
09/18/2017

Variational Methods for Normal Integration

The need for an efficient method of integration of a dense normal field ...

Please sign up or login with your details

Forgot password? Click here to reset