PHI-MVS: Plane Hypothesis Inference Multi-view Stereo for Large-Scale Scene Reconstruction

04/13/2021
by   Shang Sun, et al.
0

PatchMatch based Multi-view Stereo (MVS) algorithms have achieved great success in large-scale scene reconstruction tasks. However, reconstruction of texture-less planes often fails as similarity measurement methods may become ineffective on these regions. Thus, a new plane hypothesis inference strategy is proposed to handle the above issue. The procedure consists of two steps: First, multiple plane hypotheses are generated using filtered initial depth maps on regions that are not successfully recovered; Second, depth hypotheses are selected using Markov Random Field (MRF). The strategy can significantly improve the completeness of reconstruction results with only acceptable computing time increasing. Besides, a new acceleration scheme similar to dilated convolution can speed up the depth map estimating process with only a slight influence on the reconstruction. We integrated the above ideas into a new MVS pipeline, Plane Hypothesis Inference Multi-view Stereo (PHI-MVS). The result of PHI-MVS is validated on ETH3D public benchmarks, and it demonstrates competing performance against the state-of-the-art.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 1

page 3

page 6

page 7

03/22/2022

PlaneMVS: 3D Plane Reconstruction from Multi-View Stereo

We present a novel framework named PlaneMVS for 3D plane reconstruction ...
11/27/2019

Deep Stereo using Adaptive Thin Volume Representation with Uncertainty Awareness

We present Uncertainty-aware Cascaded Stereo Network (UCS-Net) for 3D re...
05/21/2018

Multi-View Stereo with Asymmetric Checkerboard Propagation and Multi-Hypothesis Joint View Selection

In computer vision domain, how to fast and accurately perform multiview ...
11/25/2020

Attention Aware Cost Volume Pyramid Based Multi-view Stereo Network for 3D Reconstruction

We present an efficient multi-view stereo (MVS) network for 3D reconstru...
03/26/2019

TAPA-MVS: Textureless-Aware PAtchMatch Multi-View Stereo

One of the most successful approaches in Multi-View Stereo estimates a d...
03/02/2022

iMVS: Improving MVS Networks by Learning Depth Discontinuities

Existing learning-based multi-view stereo (MVS) techniques are effective...
10/23/2020

BP-MVSNet: Belief-Propagation-Layers for Multi-View-Stereo

In this work, we propose BP-MVSNet, a convolutional neural network (CNN)...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.