Supervised Learning of the Next-Best-View for 3D Object Reconstruction

05/14/2019
by   Miguel Mendoza, et al.
0

Motivated by the advances in 3D sensing technology and the spreading of low-cost robotic platforms, 3D object reconstruction has become a common task in many areas. Nevertheless, the selection of the optimal sensor pose that maximizes the reconstructed surface is a problem that remains open. It is known in the literature as the next-best-view planning problem. In this paper, we propose a novel next-best-view planning scheme based on supervised deep learning. The scheme contains an algorithm for automatic generation of datasets and an original three-dimensional convolutional neural network (3D-CNN) used to learn the next-best-view. Unlike previous work where the problem is addressed as a search, the trained 3D-CNN directly predicts the sensor pose. We present a comparison of the proposed network against a similar net, and we present several experiments of the reconstruction of unknown objects validating the effectiveness of the proposed scheme.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/23/2021

Next-best-view Regression using a 3D Convolutional Neural Network

Automated three-dimensional (3D) object reconstruction is the task of bu...
research
11/03/2018

Auto-ML Deep Learning for Rashi Scripts OCR

In this work we propose an OCR scheme for manuscripts printed in Rashi f...
research
04/03/2020

Learning Pose-invariant 3D Object Reconstruction from Single-view Images

Learning to reconstruct 3D shapes using 2D images is an active research ...
research
03/29/2023

Active Implicit Object Reconstruction using Uncertainty-guided Next-Best-View Optimziation

Actively planning sensor views during object reconstruction is essential...
research
04/03/2023

One-Shot View Planning for Fast and Complete Unknown Object Reconstruction

Current view planning (VP) systems usually adopt an iterative pipeline w...
research
09/14/2014

Cavlectometry: Towards Holistic Reconstruction of Large Mirror Objects

We introduce a method based on the deflectometry principle for the recon...
research
03/22/2016

Active Detection and Localization of Textureless Objects in Cluttered Environments

This paper introduces an active object detection and localization framew...

Please sign up or login with your details

Forgot password? Click here to reset