One-Shot View Planning for Fast and Complete Unknown Object Reconstruction

04/03/2023
by   Sicong Pan, et al.
0

Current view planning (VP) systems usually adopt an iterative pipeline with next-best-view (NBV) methods that can autonomously perform 3D reconstruction of unknown objects. However, they are slowed down by local path planning, which is improved by our previously proposed set-covering-based network SCVP using one-shot view planning and global path planning. In this work, we propose a combined pipeline that selects a few NBVs before activating the network to improve model completeness. However, this pipeline will result in more views than expected because the SCVP has not been trained from multiview scenarios. To reduce the overall number of views and paths required, we propose a multiview-activated architecture MA-SCVP and an efficient dataset sampling method for view planning based on a long-tail distribution. Ablation studies confirm the optimal network architecture, the sampling method and the number of samples, the NBV method and the number of NBVs in our combined pipeline. Comparative experiments support the claim that our system achieves faster and more complete reconstruction than state-of-the-art systems. For the reference of the community, we make the source codes public.

READ FULL TEXT

page 10

page 12

page 17

research
04/01/2020

One-shot path planning for multi-agent systems using fully convolutional neural network

Path planning plays a crucial role in robot action execution, since a pa...
research
09/27/2022

Efficient View Path Planning for Autonomous Implicit Reconstruction

Implicit neural representations have shown promising potential for the 3...
research
09/10/2021

Optimizing Space Utilization for More Effective Multi-Robot Path Planning

We perform a systematic exploration of the principle of Space Utilizatio...
research
10/04/2019

Higher Order Function Networks for View Planning and Multi-View Reconstruction

We consider the problem of planning views for a robot to acquire images ...
research
05/31/2021

Single-query Path Planning Using Sample-efficient Probability Informed Trees

In this work, we present a novel sampling-based path planning method, ca...
research
05/14/2019

Supervised Learning of the Next-Best-View for 3D Object Reconstruction

Motivated by the advances in 3D sensing technology and the spreading of ...
research
12/17/2022

Occupancy Grid Based Reactive Planner

This paper proposes a perception and path planning pipeline for autonomo...

Please sign up or login with your details

Forgot password? Click here to reset