Online Photometric Calibration for Auto Exposure Video for Realtime Visual Odometry and SLAM

10/05/2017
by   Paul Bergmann, et al.
0

Recent direct visual odometry and SLAM algorithms have demonstrated impressive levels of precision. However, they require a photometric camera calibration in order to achieve competitive results. Hence, the respective algorithm cannot be directly applied to an off-the-shelf-camera or to a video sequence acquired with an unknown camera. In this work we propose a method for online photometric calibration which enables to process auto exposure videos with visual odometry precisions that are on par with those of photometrically calibrated videos. Our algorithm recovers the exposure times of consecutive frames, the camera response function, and the attenuation factors of the sensor irradiance due to vignetting. Gain robust KLT feature tracks are used to obtain scene point correspondences as input to a nonlinear optimization framework. We show that our approach can reliably calibrate arbitrary video sequences by evaluating it on datasets for which full photometric ground truth is available. We further show that our calibration can improve the performance of a state-of-the-art direct visual odometry method that works solely on pixel intensities, calibrating for photometric parameters in an online fashion in realtime.

READ FULL TEXT

page 2

page 3

page 4

page 6

page 7

research
07/09/2016

A Photometrically Calibrated Benchmark For Monocular Visual Odometry

We present a dataset for evaluating the tracking accuracy of monocular v...
research
05/28/2023

OSPC: Online Sequential Photometric Calibration

Photometric calibration is essential to many computer vision application...
research
09/08/2021

Recalibrating the KITTI Dataset Camera Setup for Improved Odometry Accuracy

Over the last decade, one of the most relevant public datasets for evalu...
research
02/08/2021

Learned Camera Gain and Exposure Control for Improved Visual Feature Detection and Matching

Successful visual navigation depends upon capturing images that contain ...
research
04/26/2019

GN-Net: The Gauss-Newton Loss for Deep Direct SLAM

Direct methods for SLAM have shown exceptional performance on odometry t...
research
02/23/2022

MITI: SLAM Benchmark for Laparoscopic Surgery

We propose a new benchmark for evaluating stereoscopic visual-inertial c...
research
05/11/2017

Challenges in Monocular Visual Odometry: Photometric Calibration, Motion Bias and Rolling Shutter Effect

Monocular visual odometry (VO) has seen tremendous improvements in accur...

Please sign up or login with your details

Forgot password? Click here to reset