AACVP-MVSNet
The code for AACVP-MVSNet
view repo
We present an efficient multi-view stereo (MVS) network for 3D reconstruction from multiview images. While previous learning based reconstruction approaches performed quite well, most of them estimate depth maps at a fixed resolution using plane sweep volumes with a fixed depth hypothesis at each plane, which requires densely sampled planes for desired accuracy and therefore is difficult to achieve high resolution depth maps. In this paper we introduce a coarseto-fine depth inference strategy to achieve high resolution depth. This strategy estimates the depth map at coarsest level, while the depth maps at finer levels are considered as the upsampled depth map from previous level with pixel-wise depth residual. Thus, we narrow the depth searching range with priori information from previous level and construct new cost volumes from the pixel-wise depth residual to perform depth map refinement. Then the final depth map could be achieved iteratively since all the parameters are shared between different levels. At each level, the self-attention layer is introduced to the feature extraction block for capturing the long range dependencies for depth inference task, and the cost volume is generated using similarity measurement instead of the variance based methods used in previous work. Experiments were conducted on both the DTU benchmark dataset and recently released BlendedMVS dataset. The results demonstrated that our model could outperform most state-of-the-arts (SOTA) methods. The codebase of this project is at https://github.com/ArthasMil/AACVP-MVSNet.
READ FULL TEXT
We propose a cost volume based neural network for depth inference from
m...
read it
We present Uncertainty-aware Cascaded Stereo Network (UCS-Net) for 3D
re...
read it
3D reconstruction from a single RGB image is a challenging problem in
co...
read it
Almost all previous deep learning-based multi-view stereo (MVS) approach...
read it
We proposed an unsupervised learning-based network, named NPF-MVSNet, fo...
read it
We present an end-to-end deep learning architecture for depth map infere...
read it
The present MVS methods with deep learning have an impressive performanc...
read it
The code for AACVP-MVSNet
Comments
There are no comments yet.