Multi-View Guided Multi-View Stereo

10/20/2022
by   Matteo Poggi, et al.
35

This paper introduces a novel deep framework for dense 3D reconstruction from multiple image frames, leveraging a sparse set of depth measurements gathered jointly with image acquisition. Given a deep multi-view stereo network, our framework uses sparse depth hints to guide the neural network by modulating the plane-sweep cost volume built during the forward step, enabling us to infer constantly much more accurate depth maps. Moreover, since multiple viewpoints can provide additional depth measurements, we propose a multi-view guidance strategy that increases the density of the sparse points used to guide the network, thus leading to even more accurate results. We evaluate our Multi-View Guided framework within a variety of state-of-the-art deep multi-view stereo networks, demonstrating its effectiveness at improving the results achieved by each of them on BlendedMVG and DTU datasets.

READ FULL TEXT

page 1

page 3

page 6

research
11/30/2020

How Good MVSNets Are at Depth Fusion

We study the effects of the additional input to deep multi-view stereo m...
research
07/30/2022

Learning Pseudo Front Depth for 2D Forward-Looking Sonar-based Multi-view Stereo

Retrieving the missing dimension information in acoustic images from 2D ...
research
05/24/2019

Guided Stereo Matching

Stereo is a prominent technique to infer dense depth maps from images, a...
research
04/27/2021

MVS2D: Efficient Multi-view Stereo via Attention-Driven 2D Convolutions

Deep learning has made significant impacts on multi-view stereo systems....
research
04/13/2021

PHI-MVS: Plane Hypothesis Inference Multi-view Stereo for Large-Scale Scene Reconstruction

PatchMatch based Multi-view Stereo (MVS) algorithms have achieved great ...
research
01/21/2020

Deep Depth Prior for Multi-View Stereo

It was recently shown that the structure of convolutional neural network...
research
11/05/2018

A Differential Volumetric Approach to Multi-View Photometric Stereo

Highly accurate 3D volumetric reconstruction is still an open research t...

Please sign up or login with your details

Forgot password? Click here to reset