Intrinsic3D: High-Quality 3D Reconstruction by Joint Appearance and Geometry Optimization with Spatially-Varying Lighting

08/04/2017
by   Robert Maier, et al.
0

We introduce a novel method to obtain high-quality 3D reconstructions from consumer RGB-D sensors. Our core idea is to simultaneously optimize for geometry encoded in a signed distance field (SDF), textures from automatically-selected keyframes, and their camera poses along with material and scene lighting. To this end, we propose a joint surface reconstruction approach that is based on Shape-from-Shading (SfS) techniques and utilizes the estimation of spatially-varying spherical harmonics (SVSH) from subvolumes of the reconstructed scene. Through extensive examples and evaluations, we demonstrate that our method dramatically increases the level of detail in the reconstructed scene geometry and contributes highly to consistent surface texture recovery.

READ FULL TEXT

page 1

page 7

page 8

page 10

page 11

page 12

page 13

page 14

research
07/02/2022

PhotoScene: Photorealistic Material and Lighting Transfer for Indoor Scenes

Most indoor 3D scene reconstruction methods focus on recovering 3D geome...
research
10/21/2022

High-Quality RGB-D Reconstruction via Multi-View Uncalibrated Photometric Stereo and Gradient-SDF

Fine-detailed reconstructions are in high demand in many applications. H...
research
04/20/2021

Lighting, Reflectance and Geometry Estimation from 360^∘ Panoramic Stereo

We propose a method for estimating high-definition spatially-varying lig...
research
09/19/2022

BareSkinNet: De-makeup and De-lighting via 3D Face Reconstruction

We propose BareSkinNet, a novel method that simultaneously removes makeu...
research
05/23/2019

Plane-Based Optimization of Geometry and Texture for RGB-D Reconstruction of Indoor Scenes

We present a novel approach to reconstruct RGB-D indoor scene with plane...
research
01/07/2022

NeROIC: Neural Rendering of Objects from Online Image Collections

We present a novel method to acquire object representations from online ...
research
12/06/2015

The Next Best Underwater View

To image in high resolution large and occlusion-prone scenes, a camera m...

Please sign up or login with your details

Forgot password? Click here to reset