Detail-preserving and Content-aware Variational Multi-view Stereo Reconstruction

05/03/2015
by   Zhaoxin Li, et al.
0

Accurate recovery of 3D geometrical surfaces from calibrated 2D multi-view images is a fundamental yet active research area in computer vision. Despite the steady progress in multi-view stereo reconstruction, most existing methods are still limited in recovering fine-scale details and sharp features while suppressing noises, and may fail in reconstructing regions with few textures. To address these limitations, this paper presents a Detail-preserving and Content-aware Variational (DCV) multi-view stereo method, which reconstructs the 3D surface by alternating between reprojection error minimization and mesh denoising. In reprojection error minimization, we propose a novel inter-image similarity measure, which is effective to preserve fine-scale details of the reconstructed surface and builds a connection between guided image filtering and image registration. In mesh denoising, we propose a content-aware ℓ_p-minimization algorithm by adaptively estimating the p value and regularization parameters based on the current input. It is much more promising in suppressing noise while preserving sharp features than conventional isotropic mesh smoothing. Experimental results on benchmark datasets demonstrate that our DCV method is capable of recovering more surface details, and obtains cleaner and more accurate reconstructions than state-of-the-art methods. In particular, our method achieves the best results among all published methods on the Middlebury dino ring and dino sparse ring datasets in terms of both completeness and accuracy.

READ FULL TEXT

page 1

page 3

page 6

page 7

page 8

page 10

page 11

page 13

research
04/08/2023

POEM: Reconstructing Hand in a Point Embedded Multi-view Stereo

Enable neural networks to capture 3D geometrical-aware features is essen...
research
04/26/2023

Multi-View Stereo Representation Revisit: Region-Aware MVSNet

Deep learning-based multi-view stereo has emerged as a powerful paradigm...
research
04/21/2016

Automatic 3D Reconstruction of Manifold Meshes via Delaunay Triangulation and Mesh Sweeping

In this paper we propose a new approach to incrementally initialize a ma...
research
01/17/2018

Multi-View Stereo 3D Edge Reconstruction

This paper presents a novel method for the reconstruction of 3D edges in...
research
02/05/2016

Efficient Multi-view Performance Capture of Fine-Scale Surface Detail

We present a new effective way for performance capture of deforming mesh...
research
05/21/2019

Mesh-based Camera Pairs Selection and Occlusion-Aware Masking for Mesh Refinement

Many Multi-View-Stereo algorithms extract a 3D mesh model of a scene, af...
research
03/16/2015

PiMPeR: Piecewise Dense 3D Reconstruction from Multi-View and Multi-Illumination Images

In this paper, we address the problem of dense 3D reconstruction from mu...

Please sign up or login with your details

Forgot password? Click here to reset