DeepAI AI Chat
Log In Sign Up

Learning Inter- and Intra-frame Representations for Non-Lambertian Photometric Stereo

by   Yanlong Cao, et al.
Zhejiang University
Louisiana State University

In this paper, we build a two-stage Convolutional Neural Network (CNN) architecture to construct inter- and intra-frame representations based on an arbitrary number of images captured under different light directions, performing accurate normal estimation of non-Lambertian objects. We experimentally investigate numerous network design alternatives for identifying the optimal scheme to deploy inter-frame and intra-frame feature extraction modules for the photometric stereo problem. Moreover, we propose to utilize the easily obtained object mask for eliminating adverse interference from invalid background regions in intra-frame spatial convolutions, thus effectively improve the accuracy of normal estimation for surfaces made of dark materials or with cast shadows. Experimental results demonstrate that proposed masked two-stage photometric stereo CNN model (MT-PS-CNN) performs favorably against state-of-the-art photometric stereo techniques in terms of both accuracy and efficiency. In addition, the proposed method is capable of predicting accurate and rich surface normal details for non-Lambertian objects of complex geometry and performs stably given inputs captured in both sparse and dense lighting distributions.


page 1

page 2

page 3

page 4

page 5

page 6

page 7

page 8


Deep Uncalibrated Photometric Stereo via Inter-Intra Image Feature Fusion

Uncalibrated photometric stereo is proposed to estimate the detailed sur...

Scalable, Detailed and Mask-Free Universal Photometric Stereo

In this paper, we introduce SDM-UniPS, a groundbreaking Scalable, Detail...

An Optimal Experimental Design Approach for Light Configurations in Photometric Stereo

This paper presents a technique for finding the surface normal of an obj...

SPLINE-Net: Sparse Photometric Stereo through Lighting Interpolation and Normal Estimation Networks

This paper solves the Sparse Photometric stereo through Lighting Interpo...

F2Net: Learning to Focus on the Foreground for Unsupervised Video Object Segmentation

Although deep learning based methods have achieved great progress in uns...

Robust Photometric Stereo Using Learned Image and Gradient Dictionaries

Photometric stereo is a method for estimating the normal vectors of an o...

Incorporating Lambertian Priors into Surface Normals Measurement

The goal of photometric stereo is to measure the precise surface normal ...