Rethinking Generic Camera Models for Deep Single Image Camera Calibration to Recover Rotation and Fisheye Distortion

11/25/2021
by   Nobuhiko Wakai, et al.
12

Although recent learning-based calibration methods can predict extrinsic and intrinsic camera parameters from a single image, the accuracy of these methods is degraded in fisheye images. This degradation is caused by mismatching between the actual projection and expected projection. To address this problem, we propose a generic camera model that has the potential to address various types of distortion. Our generic camera model is utilized for learning-based methods through a closed-form numerical calculation of the camera projection. Simultaneously to recover rotation and fisheye distortion, we propose a learning-based calibration method that uses the camera model. Furthermore, we propose a loss function that alleviates the bias of the magnitude of errors for four extrinsic and intrinsic camera parameters. Extensive experiments demonstrated that our proposed method outperformed conventional methods on two largescale datasets and images captured by off-the-shelf fisheye cameras. Moreover, we are the first researchers to analyze the performance of learning-based methods using various types of projection for off-the-shelf cameras.

READ FULL TEXT

page 1

page 7

page 8

research
03/30/2023

Deep Single Image Camera Calibration by Heatmap Regression to Recover Fisheye Images Under ManhattanWorld AssumptionWithout Ambiguity

In orthogonal world coordinates, a Manhattan world lying along cuboid bu...
research
02/14/2023

Camera Calibration without Camera Access – A Robust Validation Technique for Extended PnP Methods

A challenge in image based metrology and forensics is intrinsic camera c...
research
01/21/2021

Three-Dimensional Investigation of the Metric Properties of Parabolic Double Projection Involving Catadioptric Camera

This paper presents an analytical study for the metric properties of the...
research
02/04/2020

Audio-Visual Calibration with Polynomial Regression for 2-D Projection Using SVD-PHAT

This paper proposes a straightforward 2-D method to spatially calibrate ...
research
10/07/2021

Camera Calibration through Camera Projection Loss

Camera calibration is a necessity in various tasks including 3D reconstr...
research
12/05/2022

Single image calibration using knowledge distillation approaches

Although recent deep learning-based calibration methods can predict extr...
research
08/30/2019

Animated Stickies: Fast Video Projection Mapping onto a Markerless Plane through a Direct Closed-Loop Alignment

This paper presents a fast projection mapping method for moving image co...

Please sign up or login with your details

Forgot password? Click here to reset