Solving Occlusion in Terrain Mapping with Neural Networks

09/15/2021
by   Maximilian Stölzle, et al.
5

Accurate and complete terrain maps enhance the awareness of autonomous robots and enable safe and optimal path planning. Rocks and topography often create occlusions and lead to missing elevation information in the Digital Elevation Map (DEM). Currently, mostly traditional inpainting techniques based on diffusion or patch-matching are used by autonomous mobile robots to fill-in incomplete DEMs. These methods cannot leverage the high-level terrain characteristics and the geometric constraints of line of sight we humans use intuitively to predict occluded areas. We propose to use neural networks to reconstruct the occluded areas in DEMs. We introduce a self-supervised learning approach capable of training on real-world data without a need for ground-truth information. We accomplish this by adding artificial occlusion to the incomplete elevation maps constructed on a real robot by performing ray casting. We first evaluate a supervised learning approach on synthetic data for which we have the full ground-truth available and subsequently move to several real-world datasets. These real-world datasets were recorded during autonomous exploration of both structured and unstructured terrain with a legged robot, and additionally in a planetary scenario on Lunar analogue terrain. We state a significant improvement compared to the Telea and Navier-Stokes baseline methods both on synthetic terrain and for the real-world datasets. Our neural network is able to run in real-time on both CPU and GPU with suitable sampling rates for autonomous ground robots.

READ FULL TEXT

page 1

page 2

page 4

page 7

research
06/06/2021

Occlusion-aware Unsupervised Learning of Depth from 4-D Light Fields

Depth estimation is a fundamental issue in 4-D light field processing an...
research
05/26/2021

Self-supervised Monocular Multi-robot Relative Localization with Efficient Deep Neural Networks

Relative localization is an important ability for multiple robots to per...
research
11/21/2021

Self-Supervised Point Cloud Completion via Inpainting

When navigating in urban environments, many of the objects that need to ...
research
05/15/2020

Exploring the Capabilities and Limits of 3D Monocular Object Detection – A Study on Simulation and Real World Data

3D object detection based on monocular camera data is a key enabler for ...
research
02/21/2023

Learning 3D Photography Videos via Self-supervised Diffusion on Single Images

3D photography renders a static image into a video with appealing 3D vis...
research
03/04/2022

OPAL: Occlusion Pattern Aware Loss for Unsupervised Light Field Disparity Estimation

Light field disparity estimation is an essential task in computer vision...
research
11/08/2020

Learning-based 3D Occupancy Prediction for Autonomous Navigation in Occluded Environments

In autonomous navigation of mobile robots, sensors suffer from massive o...

Please sign up or login with your details

Forgot password? Click here to reset