CP+: Camera Poses Augmentation with Large-scale LiDAR Maps

02/23/2023
by   Jiadi Cui, et al.
0

Large-scale colored point clouds have many advantages in navigation or scene display. Relying on cameras and LiDARs, which are now widely used in reconstruction tasks, it is possible to obtain such colored point clouds. However, the information from these two kinds of sensors is not well fused in many existing frameworks, resulting in poor colorization results, thus resulting in inaccurate camera poses and damaged point colorization results. We propose a novel framework called Camera Pose Augmentation (CP+) to improve the camera poses and align them directly with the LiDAR-based point cloud. Initial coarse camera poses are given by LiDAR-Inertial or LiDAR-Inertial-Visual Odometry with approximate extrinsic parameters and time synchronization. The key steps to improve the alignment of the images consist of selecting a point cloud corresponding to a region of interest in each camera view, extracting reliable edge features from this point cloud, and deriving 2D-3D line correspondences which are used towards iterative minimization of the re-projection error.

READ FULL TEXT

page 2

page 4

page 5

page 6

research
10/24/2016

A coarse-to-fine algorithm for registration in 3D street-view cross-source point clouds

With the development of numerous 3D sensing technologies, object registr...
research
04/01/2020

Monocular Camera Localization in Prior LiDAR Maps with 2D-3D Line Correspondences

Light-weight camera localization in existing maps is essential for visio...
research
02/28/2022

Large-Scale 3D Semantic Reconstruction for Automated Driving Vehicles with Adaptive Truncated Signed Distance Function

The Large-scale 3D reconstruction, texturing and semantic mapping are no...
research
05/30/2022

LiDAR-aid Inertial Poser: Large-scale Human Motion Capture by Sparse Inertial and LiDAR Sensors

We propose a multi-sensor fusion method for capturing challenging 3D hum...
research
02/01/2023

A Flexible Framework for Virtual Omnidirectional Vision to Improve Operator Situation Awareness

During teleoperation of a mobile robot, providing good operator situatio...
research
09/05/2018

Reconstruction and Registration of Large-Scale Medical Scene Using Point Clouds Data from Different Modalities

Sensing the medical scenario can ensure the safety during the surgical o...
research
09/11/2023

SIM-Sync: From Certifiably Optimal Synchronization over the 3D Similarity Group to Scene Reconstruction with Learned Depth

This paper presents SIM-Sync, a certifiably optimal algorithm that estim...

Please sign up or login with your details

Forgot password? Click here to reset