DeepAI AI Chat
Log In Sign Up

Learning Inter- and Intra-frame Representations for Non-Lambertian Photometric Stereo

12/26/2020
by   Yanlong Cao, et al.
Zhejiang University
Louisiana State University
8

In this paper, we build a two-stage Convolutional Neural Network (CNN) architecture to construct inter- and intra-frame representations based on an arbitrary number of images captured under different light directions, performing accurate normal estimation of non-Lambertian objects. We experimentally investigate numerous network design alternatives for identifying the optimal scheme to deploy inter-frame and intra-frame feature extraction modules for the photometric stereo problem. Moreover, we propose to utilize the easily obtained object mask for eliminating adverse interference from invalid background regions in intra-frame spatial convolutions, thus effectively improve the accuracy of normal estimation for surfaces made of dark materials or with cast shadows. Experimental results demonstrate that proposed masked two-stage photometric stereo CNN model (MT-PS-CNN) performs favorably against state-of-the-art photometric stereo techniques in terms of both accuracy and efficiency. In addition, the proposed method is capable of predicting accurate and rich surface normal details for non-Lambertian objects of complex geometry and performs stably given inputs captured in both sparse and dense lighting distributions.

READ FULL TEXT

page 1

page 2

page 3

page 4

page 5

page 6

page 7

page 8

08/06/2022

Deep Uncalibrated Photometric Stereo via Inter-Intra Image Feature Fusion

Uncalibrated photometric stereo is proposed to estimate the detailed sur...
03/28/2023

Scalable, Detailed and Mask-Free Universal Photometric Stereo

In this paper, we introduce SDM-UniPS, a groundbreaking Scalable, Detail...
04/11/2022

An Optimal Experimental Design Approach for Light Configurations in Photometric Stereo

This paper presents a technique for finding the surface normal of an obj...
05/10/2019

SPLINE-Net: Sparse Photometric Stereo through Lighting Interpolation and Normal Estimation Networks

This paper solves the Sparse Photometric stereo through Lighting Interpo...
12/04/2020

F2Net: Learning to Focus on the Foreground for Unsupervised Video Object Segmentation

Although deep learning based methods have achieved great progress in uns...
09/30/2017

Robust Photometric Stereo Using Learned Image and Gradient Dictionaries

Photometric stereo is a method for estimating the normal vectors of an o...
07/15/2021

Incorporating Lambertian Priors into Surface Normals Measurement

The goal of photometric stereo is to measure the precise surface normal ...