Incremental 3D Scene Completion for Safe and Efficient Exploration Mapping and Planning

by   Lukas Schmid, et al.

Exploration of unknown environments is a fundamental problem in robotics and an essential component in numerous applications of autonomous systems. A major challenge in exploring unknown environments is that the robot has to plan with the limited information available at each time step. While most current approaches rely on heuristics and assumption to plan paths based on these partial observations, we instead propose a novel way to integrate deep learning into exploration by leveraging 3D scene completion for informed, safe, and interpretable exploration mapping and planning. Our approach, SC-Explorer, combines scene completion using a novel incremental fusion mechanism and a newly proposed hierarchical multi-layer mapping approach, to guarantee safety and efficiency of the robot. We further present an informative path planning method, leveraging the capabilities of our mapping approach and a novel scene-completion-aware information gain. While our method is generally applicable, we evaluate it in the use case of a Micro Aerial Vehicle (MAV). We thoroughly study each component in high-fidelity simulation experiments using only mobile hardware, and show that our method can speed up coverage of an environment by 73 accuracy. Even if scene completions are not included in the final map, we show that they can be used to guide the robot to choose more informative paths, speeding up the measurement of the scene with the robot's sensors by 35 make our methods available as open-source.


page 1

page 5

page 7

page 11


A Unified Approach for Autonomous Volumetric Exploration of Large Scale Environments under Severe Odometry Drift

Exploration is a fundamental problem in robot autonomy. A major limitati...

3D Reactive Control and Frontier-Based Exploration for Unstructured Environments

The paper proposes a reliable and robust planning solution to the long r...

An Efficient Sampling-based Method for Online Informative Path Planning in Unknown Environments

The ability to plan informative paths online is essential to robot auton...

Appendix for the Motion Primitives-based Path Planning for Fast and Agile Exploration Method

This manuscript presents enhancements on our motion-primitives explorati...

VoxelCache: Accelerating Online Mapping in Robotics and 3D Reconstruction Tasks

Real-time 3D mapping is a critical component in many important applicati...

Functional Path Optimisation for Exploration in Continuous Occupancy Maps

Autonomous exploration is a complex task where the robot moves through a...

Fast and Compute-efficient Sampling-based Local Exploration Planning via Distribution Learning

Exploration is a fundamental problem in robotics. While sampling-based p...

Please sign up or login with your details

Forgot password? Click here to reset