DeepAI AI Chat
Log In Sign Up

Predicting the Next Best View for 3D Mesh Refinement

by   Luca Morreale, et al.
Politecnico di Milano

3D reconstruction is a core task in many applications such as robot navigation or sites inspections. Finding the best poses to capture part of the scene is one of the most challenging topic that goes under the name of Next Best View. Recently, many volumetric methods have been proposed; they choose the Next Best View by reasoning over a 3D voxelized space and by finding which pose minimizes the uncertainty decoded into the voxels. Such methods are effective, but they do not scale well since the underlaying representation requires a huge amount of memory. In this paper we propose a novel mesh-based approach which focuses on the worst reconstructed region of the environment mesh. We define a photo-consistent index to evaluate the 3D mesh accuracy, and an energy function over the worst regions of the mesh which takes into account the mutual parallax with respect to the previous cameras, the angle of incidence of the viewing ray to the surface and the visibility of the region. We test our approach over a well known dataset and achieve state-of-the-art results.


page 8

page 9


Mesh-based Camera Pairs Selection and Occlusion-Aware Masking for Mesh Refinement

Many Multi-View-Stereo algorithms extract a 3D mesh model of a scene, af...

An Effective Loss Function for Generating 3D Models from Single 2D Image without Rendering

Differentiable rendering is a very successful technique that applies to ...

Facetwise Mesh Refinement for Multi-View Stereo

Mesh refinement is a fundamental step for accurate Multi-View Stereo. It...

Pipeline for 3D reconstruction of the human body from AR/VR headset mounted egocentric cameras

In this paper, we propose a novel pipeline for the 3D reconstruction of ...

Voxel Structure-based Mesh Reconstruction from a 3D Point Cloud

Mesh reconstruction from a 3D point cloud is an important topic in the f...

Mesh-based Dynamics with Occlusion Reasoning for Cloth Manipulation

Self-occlusion is challenging for cloth manipulation, as it makes it dif...

VM-Net: Mesh Modeling to Assist Segmentation in Volumetric Data

CNN-based volumetric methods that label individual voxels now dominate t...