iMVS: Improving MVS Networks by Learning Depth Discontinuities

03/02/2022
by   Nail Ibrahimli, et al.
0

Existing learning-based multi-view stereo (MVS) techniques are effective in terms of completeness in reconstruction. We further improve these techniques by learning depth continuities. Our idea is to jointly estimate the depth and boundary maps. To this end, we introduce learning-based MVS strategies to improve the quality of depth maps via mixture density and depth discontinuity learning. We validate our idea and demonstrate that our strategies can be easily integrated into existing learning-based MVS pipelines where the reconstruction depends on high-quality depth map estimation. We also introduce a bimodal depth representation and a novel spatial regularization approach to the MVS networks. Extensive experiments on various datasets show that our method sets a new state of the art in terms of completeness and overall reconstruction quality. Experiments also demonstrate that the presented model and strategies have good generalization capabilities. The source code will be available soon.

READ FULL TEXT

page 4

page 6

page 8

research
03/02/2020

A-TVSNet: Aggregated Two-View Stereo Network for Multi-View Stereo Depth Estimation

We propose a learning-based network for depth map estimation from multi-...
research
01/19/2022

A Confidence-based Iterative Solver of Depths and Surface Normals for Deep Multi-view Stereo

In this paper, we introduce a deep multi-view stereo (MVS) system that j...
research
03/29/2020

Fast-MVSNet: Sparse-to-Dense Multi-View Stereo With Learned Propagation and Gauss-Newton Refinement

Almost all previous deep learning-based multi-view stereo (MVS) approach...
research
03/22/2018

Prioritized Multi-View Stereo Depth Map Generation Using Confidence Prediction

In this work, we propose a novel approach to prioritize the depth map co...
research
04/13/2021

PHI-MVS: Plane Hypothesis Inference Multi-view Stereo for Large-Scale Scene Reconstruction

PatchMatch based Multi-view Stereo (MVS) algorithms have achieved great ...
research
07/18/2023

Constraining Depth Map Geometry for Multi-View Stereo: A Dual-Depth Approach with Saddle-shaped Depth Cells

Learning-based multi-view stereo (MVS) methods deal with predicting accu...
research
06/21/2022

Enhancing Multi-view Stereo with Contrastive Matching and Weighted Focal Loss

Learning-based multi-view stereo (MVS) methods have made impressive prog...

Please sign up or login with your details

Forgot password? Click here to reset