Coarse-to-fine Hybrid 3D Mapping System with Co-calibrated Omnidirectional Camera and Non-repetitive LiDAR

01/30/2023
by   Ziliang Miao, et al.
0

This paper presents a novel 3D mapping robot with an omnidirectional field-of-view (FoV) sensor suite composed of a non-repetitive LiDAR and an omnidirectional camera. Thanks to the non-repetitive scanning nature of the LiDAR, an automatic targetless co-calibration method is proposed to simultaneously calibrate the intrinsic parameters for the omnidirectional camera and the extrinsic parameters for the camera and LiDAR, which is crucial for the required step in bringing color and texture information to the point clouds in surveying and mapping tasks. Comparisons and analyses are made to target-based intrinsic calibration and mutual information (MI)-based extrinsic calibration, respectively. With this co-calibrated sensor suite, the hybrid mapping robot integrates both the odometry-based mapping mode and stationary mapping mode. Meanwhile, we proposed a new workflow to achieve coarse-to-fine mapping, including efficient and coarse mapping in a global environment with odometry-based mapping mode; planning for viewpoints in the region-of-interest (ROI) based on the coarse map (relies on the previous work); navigating to each viewpoint and performing finer and more precise stationary scanning and mapping of the ROI. The fine map is stitched with the global coarse map, which provides a more efficient and precise result than the conventional stationary approaches and the emerging odometry-based approaches, respectively.

READ FULL TEXT

page 1

page 3

page 5

page 6

page 7

research
11/17/2020

ACSC: Automatic Calibration for Non-repetitive Scanning Solid-State LiDAR and Camera Systems

Recently, the rapid development of Solid-State LiDAR (SSL) enables low-c...
research
09/26/2022

An optimization-based IMU/Lidar/Camera Co-calibration method

Recently, multi-sensors fusion has achieved significant progress in the ...
research
05/27/2019

Heterogeneous Multi-sensor Calibration based on Graph Optimization

Many robotics and mapping systems contain multiple sensors to perceive t...
research
10/19/2021

CoFi: Coarse-to-Fine ICP for LiDAR Localization in an Efficient Long-lasting Point Cloud Map

LiDAR odometry and localization has attracted increasing research intere...
research
10/27/2020

Robust Odometry and Mapping for Multi-LiDAR Systems with Online Extrinsic Calibration

Combining multiple LiDARs enables a robot to maximize its perceptual awa...
research
09/21/2020

Time-of-Flight LiDAR-based Precise Mapping

Last two decades, the problem of robotic mapping has made a lot of progr...
research
10/07/2021

Joint calibration and mapping of satellite altimetry data using trainable variational models

Satellite radar altimeters are a key source of observation of ocean surf...

Please sign up or login with your details

Forgot password? Click here to reset