CalibDNN: Multimodal Sensor Calibration for Perception Using Deep Neural Networks

03/27/2021
by   Ganning Zhao, et al.
0

Current perception systems often carry multimodal imagers and sensors such as 2D cameras and 3D LiDAR sensors. To fuse and utilize the data for downstream perception tasks, robust and accurate calibration of the multimodal sensor data is essential. We propose a novel deep learning-driven technique (CalibDNN) for accurate calibration among multimodal sensor, specifically LiDAR-Camera pairs. The key innovation of the proposed work is that it does not require any specific calibration targets or hardware assistants, and the entire processing is fully automatic with a single model and single iteration. Results comparison among different methods and extensive experiments on different datasets demonstrates the state-of-the-art performance.

READ FULL TEXT

page 3

page 5

page 8

page 10

research
04/11/2023

SceneCalib: Automatic Targetless Calibration of Cameras and Lidars in Autonomous Driving

Accurate camera-to-lidar calibration is a requirement for sensor data fu...
research
06/22/2023

Continuous Online Extrinsic Calibration of Fisheye Camera and LiDAR

Automated driving systems use multi-modal sensor suites to ensure the re...
research
07/11/2017

RegNet: Multimodal Sensor Registration Using Deep Neural Networks

In this paper, we present RegNet, the first deep convolutional neural ne...
research
10/17/2017

Fusion of LiDAR and Camera Sensor Data for Environment Sensing in Driverless Vehicles

Driverless vehicles operate by sensing and perceiving its surrounding en...
research
09/04/2023

Focusing and Calibration of Large Scale Network Sensors using GraphBLAS Anonymized Hypersparse Matrices

Defending community-owned cyber space requires community-based efforts. ...
research
09/20/2023

STARNet: Sensor Trustworthiness and Anomaly Recognition via Approximated Likelihood Regret for Robust Edge Autonomy

Complex sensors such as LiDAR, RADAR, and event cameras have proliferate...
research
03/17/2022

DXQ-Net: Differentiable LiDAR-Camera Extrinsic Calibration Using Quality-aware Flow

Accurate LiDAR-camera extrinsic calibration is a precondition for many m...

Please sign up or login with your details

Forgot password? Click here to reset