Spatiotemporal Decoupling Based LiDAR-Camera Calibration under Arbitrary Configurations

03/14/2019
by   Bo Fu, et al.
0

LiDAR-camera calibration is a precondition for many heterogeneous systems that fuse data from LiDAR and camera. However, the constraint from the common field of view and the requirement for strict time synchronization make the calibration a challenging problem. In this paper, we propose a hybrid LiDAR-camera calibration method aiming to solve these two difficulties. The configuration between LiDAR and camera is free from their common field of view as we move the camera to cover the scenario observed by LiDAR. 3D visual reconstruction of the environment can be achieved from the sequential visual images obtained by the moving camera, which later can be aligned with the single 3D laser scan captured when both the scene and the equipment are stationary. Under this design, our method can further get rid of the influence from time synchronization between LiDAR and camera. Moreover, the extended field of view obtained by the moving camera can improve the calibration accuracy. We derive the conditions of minimal observability for our method and discuss the influence on calibration accuracy from different placements of chessboards, which can be utilized as a guideline for designing high-accuracy calibration procedures. We validate our method on both simulation platform and real-world datasets. Experiments show that our method can achieve higher accuracy than other comparable methods.

READ FULL TEXT

page 1

page 3

page 9

page 11

page 12

research
08/28/2023

INF: Implicit Neural Fusion for LiDAR and Camera

Sensor fusion has become a popular topic in robotics. However, conventio...
research
09/09/2017

Joint Calibration of Panoramic Camera and Lidar Based on Supervised Learning

In view of contemporary panoramic camera-laser scanner system, the tradi...
research
09/26/2021

A Simple Self-calibration Method for The Internal Time Synchronization of MEMS LiDAR

This paper proposes a simple self-calibration method for the internal ti...
research
09/26/2022

An optimization-based IMU/Lidar/Camera Co-calibration method

Recently, multi-sensors fusion has achieved significant progress in the ...
research
03/19/2023

A Target-Based Extrinsic Calibration Framework for Non-Overlapping Camera-Lidar Systems Using a Motion Capture System

In this work, we present a novel target-based lidar-camera extrinsic cal...
research
02/14/2023

Camera Calibration without Camera Access – A Robust Validation Technique for Extended PnP Methods

A challenge in image based metrology and forensics is intrinsic camera c...
research
07/01/2019

A Joint Optimization Approach of LiDAR-Camera Fusion for Accurate Dense 3D Reconstructions

Fusing data from LiDAR and camera is conceptually attractive because of ...

Please sign up or login with your details

Forgot password? Click here to reset