Real-time Neural Dense Elevation Mapping for Urban Terrain with Uncertainty Estimations

08/06/2022
by   Bowen Yang, et al.
0

Having good knowledge of terrain information is essential for improving the performance of various downstream tasks on complex terrains, especially for the locomotion and navigation of legged robots. We present a novel framework for neural urban terrain reconstruction with uncertainty estimations. It generates dense robot-centric elevation maps online from sparse LiDAR observations. We design a novel pre-processing and point features representation approach that ensures high robustness and computational efficiency when integrating multiple point cloud frames. A Bayesian-GAN model then recovers the detailed terrain structures while simultaneously providing the pixel-wise reconstruction uncertainty. We evaluate the proposed pipeline through extensive simulation and real-world experiments. It demonstrates efficient terrain reconstruction with high quality and real-time performance on a mobile platform, which further benefits the downstream tasks of legged robots. (See https://kin-zhang.github.io/ndem/ for more details.)

READ FULL TEXT

page 1

page 5

page 7

research
06/18/2023

Towards Real-time Scalable Dense Mapping using Robot-centric Implicit Representation

Real-time and high-quailty dense mapping is essential for robots to perf...
research
12/31/2022

Ponder: Point Cloud Pre-training via Neural Rendering

We propose a novel approach to self-supervised learning of point cloud r...
research
06/06/2023

PQM: A Point Quality Evaluation Metric for Dense Maps

LiDAR-based mapping/reconstruction are important for various application...
research
04/27/2023

Combining HoloLens with Instant-NeRFs: Advanced Real-Time 3D Mobile Mapping

This work represents a large step into modern ways of fast 3D reconstruc...
research
04/27/2022

Elevation Mapping for Locomotion and Navigation using GPU

Perceiving the surrounding environment is crucial for autonomous mobile ...
research
09/20/2022

Fast-Image2Point: Towards Real-Time Point Cloud Reconstruction of a Single Image using 3D Supervision

A key question in the problem of 3D reconstruction is how to train a mac...
research
09/01/2023

Learning State-Space Models for Mapping Spatial Motion Patterns

Mapping the surrounding environment is essential for the successful oper...

Please sign up or login with your details

Forgot password? Click here to reset