Multi view stereo with semantic priors

Patch-based stereo is nowadays a commonly used image-based technique for dense 3D reconstruction in large scale multi-view applications. The typical steps of such a pipeline can be summarized in stereo pair selection, depth map computation, depth map refinement and, finally, fusion in order to generate a complete and accurate representation of the scene in 3D. In this study, we aim to support the standard dense 3D reconstruction of scenes as implemented in the open source library OpenMVS by using semantic priors. To this end, during the depth map fusion step, along with the depth consistency check between depth maps of neighbouring views referring to the same part of the 3D scene, we impose extra semantic constraints in order to remove possible errors and selectively obtain segmented point clouds per label, boosting automation towards this direction. I n order to reassure semantic coherence between neighbouring views, additional semantic criterions can be considered, aiming to elim inate mismatches of pixels belonging in different classes.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/12/2019

NRMVS: Non-Rigid Multi-View Stereo

Scene reconstruction from unorganized RGB images is an important task in...
research
07/18/2022

Revisiting PatchMatch Multi-View Stereo for Urban 3D Reconstruction

In this paper, a complete pipeline for image-based 3D reconstruction of ...
research
11/04/2019

Technical Report: Co-learning of geometry and semantics for online 3D mapping

This paper is a technical report about our submission for the ECCV 2018 ...
research
03/22/2018

Prioritized Multi-View Stereo Depth Map Generation Using Confidence Prediction

In this work, we propose a novel approach to prioritize the depth map co...
research
08/23/2023

Select-and-Combine (SAC): A Novel Multi-Stereo Depth Fusion Algorithm for Point Cloud Generation via Efficient Local Markov Netlets

Many practical systems for image-based surface reconstruction employ a s...
research
08/19/2021

VolumeFusion: Deep Depth Fusion for 3D Scene Reconstruction

To reconstruct a 3D scene from a set of calibrated views, traditional mu...
research
05/02/2017

Active Image-based Modeling

We seek to automate the data capturing process in image-based modeling, ...

Please sign up or login with your details

Forgot password? Click here to reset