Targetless Extrinsic Calibration of Stereo Cameras, Thermal Cameras, and Laser Sensors in the Wild

09/28/2021
by   Taimeng Fu, et al.
0

The fusion of multi-modal sensors has become increasingly popular in autonomous driving and intelligent robots since it can provide richer information than any single sensor, enhance reliability in complex environments. Multi-sensor extrinsic calibration is one of the key factors of sensor fusion. However, such calibration is difficult due to the variety of sensor modalities and the requirement of calibration targets and human labor. In this paper, we demonstrate a new targetless cross-modal calibration framework by focusing on the extrinsic transformations among stereo cameras, thermal cameras, and laser sensors. Specifically, the calibration between stereo and laser is conducted in 3D space by minimizing the registration error, while the thermal extrinsic to the other two sensors is estimated by optimizing the alignment of the edge features. Our method requires no dedicated targets and performs the multi-sensor calibration in a single shot without human interaction. Experimental results show that the calibration framework is accurate and applicable in general scenes.

READ FULL TEXT

page 1

page 3

page 4

page 5

page 6

research
10/19/2022

A sensor-to-pattern calibration framework for multi-modal industrial collaborative cells

Collaborative robotic industrial cells are workspaces where robots colla...
research
11/05/2019

LACI: Low-effort Automatic Calibration of Infrastructure Sensors

Sensor calibration usually is a time consuming yet important task. While...
research
12/07/2016

Exploring the potential of combining time of flight and thermal infrared cameras for person detection

Combining new, low-cost thermal infrared and time-of-flight range sensor...
research
12/13/2016

CFD results calibration from sparse sensor observations with a case study for indoor thermal map

Current CFD calibration work has mainly focused on the CFD model calibra...
research
07/31/2019

Deep Sensor Fusion for Real-Time Odometry Estimation

Cameras and 2D laser scanners, in combination, are able to provide low-c...
research
12/29/2020

Visual-Thermal Camera Dataset Release and Multi-Modal Alignment without Calibration Information

This report accompanies a dataset release on visual and thermal camera d...

Please sign up or login with your details

Forgot password? Click here to reset