Correcting Decalibration of Stereo Cameras in Self-Driving Vehicles

01/15/2020
by   Jon Muhovič, et al.
3

We address the problem of optical decalibration in mobile stereo camera setups, especially in context of autonomous vehicles. In real world conditions, an optical system is subject to various sources of anticipated and unanticipated mechanical stress (vibration, rough handling, collisions). Mechanical stress changes the geometry between the cameras that make up the stereo pair, and as a consequence, the pre-calculated epipolar geometry is no longer valid. Our method is based on optimization of camera geometry parameters and plugs directly into the output of the stereo matching algorithm. Therefore, it is able to recover calibration parameters on image pairs obtained from a decalibrated stereo system with minimal use of additional computing resources. The number of successfully recovered depth pixels is used as an objective function, which we aim to maximize. Our simulation confirms that the method can run constantly in parallel to stereo estimation and thus help keep the system calibrated in real time. Results confirm that the method is able to recalibrate all the parameters except for the baseline distance, which scales the absolute depth readings. However, that scaling factor could be uniquely determined using any kind of absolute range finding methods (e.g. a single beam time-of-flight sensor).

READ FULL TEXT

page 1

page 2

page 6

research
07/30/2021

High-Resolution Depth Maps Based on TOF-Stereo Fusion

The combination of range sensors with color cameras can be very useful f...
research
12/14/2021

Deep Sea Bubble Stream Characterization Using Wide-Baseline Stereo Photogrammetry

Reliable quantification of natural and anthropogenic gas release (e.g.CO...
research
02/28/2022

TEScalib: Targetless Extrinsic Self-Calibration of LiDAR and Stereo Camera for Automated Driving Vehicles with Uncertainty Analysis

In this paper, we present TEScalib, a novel extrinsic self-calibration a...
research
03/28/2019

Depth from a polarisation + RGB stereo pair

In this paper, we propose a hybrid depth imaging system in which a polar...
research
10/07/2021

DoubleStar: Long-Range Attack Towards Depth Estimation based Obstacle Avoidance in Autonomous Systems

Depth estimation-based obstacle avoidance has been widely adopted by aut...
research
04/07/2020

Depth Sensing Beyond LiDAR Range

Depth sensing is a critical component of autonomous driving technologies...
research
09/19/2023

Dive Deeper into Rectifying Homography for Stereo Camera Online Self-Calibration

Accurate estimation of stereo camera extrinsic parameters is the key to ...

Please sign up or login with your details

Forgot password? Click here to reset