TAPA-MVS: Textureless-Aware PAtchMatch Multi-View Stereo

03/26/2019
by   Andrea Romanoni, et al.
0

One of the most successful approaches in Multi-View Stereo estimates a depth map and a normal map for each view via PatchMatch-based optimization and fuses them into a consistent 3D points cloud. This approach relies on photo-consistency to evaluate the goodness of a depth estimate. It generally produces very accurate results; however, the reconstructed model often lacks completeness, especially in correspondence of broad untextured areas where the photo-consistency metrics are unreliable. Assuming the untextured areas piecewise planar, in this paper we generate novel PatchMatch hypotheses so to expand reliable depth estimates in neighboring untextured regions. At the same time, we modify the photo-consistency measure such to favor standard or novel PatchMatch depth hypotheses depending on the textureness of the considered area. We also propose a depth refinement step to filter wrong estimates and to fill the gaps on both the depth maps and normal maps while preserving the discontinuities. The effectiveness of our new methods has been tested against several state of the art algorithms in the publicly available ETH3D dataset containing a wide variety of high and low-resolution images.

READ FULL TEXT

page 1

page 3

page 5

page 6

page 7

research
12/26/2019

Planar Prior Assisted PatchMatch Multi-View Stereo

The completeness of 3D models is still a challenging problem in multi-vi...
research
04/17/2019

Multi-Scale Geometric Consistency Guided Multi-View Stereo

In this paper, we propose an efficient multi-scale geometric consistency...
research
07/18/2022

Revisiting PatchMatch Multi-View Stereo for Urban 3D Reconstruction

In this paper, a complete pipeline for image-based 3D reconstruction of ...
research
04/13/2021

PHI-MVS: Plane Hypothesis Inference Multi-view Stereo for Large-Scale Scene Reconstruction

PatchMatch based Multi-view Stereo (MVS) algorithms have achieved great ...
research
12/01/2021

FaSS-MVS – Fast Multi-View Stereo with Surface-Aware Semi-Global Matching from UAV-borne Monocular Imagery

With FaSS-MVS, we present an approach for fast multi-view stereo with su...
research
08/19/2023

TSAR-MVS: Textureless-aware Segmentation and Correlative Refinement Guided Multi-View Stereo

The reconstruction of textureless areas has long been a challenging prob...
research
05/17/2019

Automated 3D recovery from very high resolution multi-view satellite images

This paper presents an automated pipeline for processing multi-view sate...

Please sign up or login with your details

Forgot password? Click here to reset