Deep Learning Methods for Calibrated Photometric Stereo and Beyond: A Survey

12/16/2022
by   Yakun Ju, et al.
0

Photometric stereo recovers the surface normals of an object from multiple images with varying shading cues, i.e., modeling the relationship between surface orientation and intensity at each pixel. Photometric stereo prevails in superior per-pixel resolution and fine reconstruction details. However, it is a complicated problem because of the non-linear relationship caused by non-Lambertian surface reflectance. Recently, various deep learning methods have shown a powerful ability in the context of photometric stereo against non-Lambertian surfaces. This paper provides a comprehensive review of existing deep learning-based calibrated photometric stereo methods. We first analyze these methods from different perspectives, including input processing, supervision, and network architecture. We summarize the performance of deep learning photometric stereo models on the most widely-used benchmark data set. This demonstrates the advanced performance of deep learning-based photometric stereo methods. Finally, we give suggestions and propose future research trends based on the limitations of existing models.

READ FULL TEXT

page 1

page 4

page 5

page 6

page 7

page 8

page 12

page 13

research
04/18/2020

On the Synergies between Machine Learning and Stereo: a Survey

Stereo matching is one of the longest-standing problems in computer visi...
research
07/15/2021

Incorporating Lambertian Priors into Surface Normals Measurement

The goal of photometric stereo is to measure the precise surface normal ...
research
03/22/2021

Leveraging Spatial and Photometric Context for Calibrated Non-Lambertian Photometric Stereo

The problem of estimating a surface shape from its observed reflectance ...
research
11/23/2019

Deep-Learning Assisted High-Resolution Binocular Stereo Depth Reconstruction

This work presents dense stereo reconstruction using high-resolution ima...
research
12/03/2017

Semi-Global Stereo Matching with Surface Orientation Priors

Semi-Global Matching (SGM) is a widely-used efficient stereo matching te...
research
11/21/2022

PS-Transformer: Learning Sparse Photometric Stereo Network using Self-Attention Mechanism

Existing deep calibrated photometric stereo networks basically aggregate...
research
03/22/2023

Deep learning-based stereo camera multi-video synchronization

Stereo vision is essential for many applications. Currently, the synchro...

Please sign up or login with your details

Forgot password? Click here to reset