Cost Volume Pyramid Network with Multi-strategies Range Searching for Multi-view Stereo

07/25/2022
by   Shiyu Gao, et al.
2

Multi-view stereo is an important research task in computer vision while still keeping challenging. In recent years, deep learning-based methods have shown superior performance on this task. Cost volume pyramid network-based methods which progressively refine depth map in coarse-to-fine manner, have yielded promising results while consuming less memory. However, these methods fail to take fully consideration of the characteristics of the cost volumes in each stage, leading to adopt similar range search strategies for each cost volume stage. In this work, we present a novel cost volume pyramid based network with different searching strategies for multi-view stereo. By choosing different depth range sampling strategies and applying adaptive unimodal filtering, we are able to obtain more accurate depth estimation in low resolution stages and iteratively upsample depth map to arbitrary resolution. We conducted extensive experiments on both DTU and BlendedMVS datasets, and results show that our method outperforms most state-of-the-art methods.

READ FULL TEXT

page 3

page 4

page 6

page 7

research
12/18/2019

Cost Volume Pyramid Based Depth Inference for Multi-View Stereo

We propose a cost volume based neural network for depth inference from m...
research
04/04/2022

RayMVSNet: Learning Ray-based 1D Implicit Fields for Accurate Multi-View Stereo

Learning-based multi-view stereo (MVS) has by far centered around 3D con...
research
12/04/2021

Generalized Binary Search Network for Highly-Efficient Multi-View Stereo

Multi-view Stereo (MVS) with known camera parameters is essentially a 1D...
research
06/22/2023

One at A Time: Multi-step Volumetric Probability Distribution Diffusion for Depth Estimation

Recent works have explored the fundamental role of depth estimation in m...
research
05/08/2022

Non-parametric Depth Distribution Modelling based Depth Inference for Multi-view Stereo

Recent cost volume pyramid based deep neural networks have unlocked the ...
research
10/16/2021

Multi-View Stereo Network with attention thin volume

We propose an efficient multi-view stereo (MVS) network for infering dep...
research
08/13/2022

DS-MVSNet: Unsupervised Multi-view Stereo via Depth Synthesis

In recent years, supervised or unsupervised learning-based MVS methods a...

Please sign up or login with your details

Forgot password? Click here to reset