Pro-Cam SSfM: Projector-Camera System for Structure and Spectral Reflectance from Motion

08/22/2019
by   Chunyu Li, et al.
2

In this paper, we propose a novel projector-camera system for practical and low-cost acquisition of a dense object 3D model with the spectral reflectance property. In our system, we use a standard RGB camera and leverage an off-the-shelf projector as active illumination for both the 3D reconstruction and the spectral reflectance estimation. We first reconstruct the 3D points while estimating the poses of the camera and the projector, which are alternately moved around the object, by combining multi-view structured light and structure-from-motion (SfM) techniques. We then exploit the projector for multispectral imaging and estimate the spectral reflectance of each 3D point based on a novel spectral reflectance estimation model considering the geometric relationship between the reconstructed 3D points and the estimated projector positions. Experimental results on several real objects demonstrate that our system can precisely acquire a dense 3D model with the full spectral reflectance property using off-the-shelf devices.

READ FULL TEXT

page 1

page 2

page 3

page 4

page 5

page 7

page 9

page 10

research
04/15/2021

Spectral MVIR: Joint Reconstruction of 3D Shape and Spectral Reflectance

Reconstructing an object's high-quality 3D shape with inherent spectral ...
research
12/18/2020

Spectral Reflectance Estimation Using Projector with Unknown Spectral Power Distribution

A lighting-based multispectral imaging system using an RGB camera and a ...
research
07/17/2020

Polarimetric Multi-View Inverse Rendering

A polarization camera has great potential for 3D reconstruction since th...
research
07/01/2020

A Dataset for Evaluating Multi-spectral Motion Estimation Methods

Visible images have been widely used for indoor motion estimation. Therm...
research
01/25/2017

Recovering 3D Planar Arrangements from Videos

Acquiring 3D geometry of real world objects has various applications in ...
research
06/03/2019

Comparing two- and three-view Computer Vision

To reconstruct the points in three dimensional space, we need at least t...
research
08/07/2023

Learning Photometric Feature Transform for Free-form Object Scan

We propose a novel framework to automatically learn to aggregate and tra...

Please sign up or login with your details

Forgot password? Click here to reset