Detailed Surface Geometry and Albedo Recovery from RGB-D Video Under Natural Illumination

02/06/2017
by   Xinxin Zuo, et al.
0

In this paper we present a novel approach for depth map enhancement from an RGB-D video sequence. The basic idea is to exploit the shading information in the color image. Instead of making assumption about surface albedo or controlled object motion and lighting, we use the lighting variations introduced by casual object movement. We are effectively calculating photometric stereo from a moving object under natural illuminations. The key technical challenge is to establish correspondences over the entire image set. We therefore develop a lighting insensitive robust pixel matching technique that out-performs optical flow method in presence of lighting variations. In addition we present an expectation-maximization framework to recover the surface normal and albedo simultaneously, without any regularization term. We have validated our method on both synthetic and real datasets to show its superior performance on both surface details recovery and intrinsic decomposition.

READ FULL TEXT

page 4

page 6

page 7

page 8

research
12/11/2020

A Dark Flash Normal Camera

Casual photography is often performed in uncontrolled lighting that can ...
research
10/21/2022

High-Quality RGB-D Reconstruction via Multi-View Uncalibrated Photometric Stereo and Gradient-SDF

Fine-detailed reconstructions are in high demand in many applications. H...
research
06/06/2022

Universal Photometric Stereo Network using Global Lighting Contexts

This paper tackles a new photometric stereo task, named universal photom...
research
05/16/2020

Saving the Sonorine: Audio Recovery Using Image Processing and Computer Vision

This paper presents a novel technique to recover audio from sonorines, a...
research
05/16/2020

Saving the Sonorine: Photovisual Audio Recovery Using Image Processing and Computer Vision Techniques

This paper presents a novel technique to recover audio from sonorines, a...
research
04/20/2020

Complex-Object Visual Inspection via Multiple Lighting Configurations

The design of an automatic visual inspection system is usually performed...
research
12/26/2014

Sparkle Vision: Seeing the World through Random Specular Microfacets

In this paper, we study the problem of reproducing the world lighting fr...

Please sign up or login with your details

Forgot password? Click here to reset