Deep Single Image Camera Calibration by Heatmap Regression to Recover Fisheye Images Under ManhattanWorld AssumptionWithout Ambiguity

03/30/2023
by   Nobuhiko Wakai, et al.
0

In orthogonal world coordinates, a Manhattan world lying along cuboid buildings is widely useful for various computer vision tasks. However, the Manhattan world has much room for improvement because the origin of pan angles from an image is arbitrary, that is, four-fold rotational symmetric ambiguity of pan angles. To address this problem, we propose a definition for the pan-angle origin based on the directions of the roads with respect to a camera and the direction of travel. We propose a learning-based calibration method that uses heatmap regression to remove the ambiguity by each direction of labeled image coordinates, similar to pose estimation keypoints. Simultaneously, our two-branched network recovers the rotation and removes fisheye distortion from a general scene image. To alleviate the lack of vanishing points in images, we introduce auxiliary diagonal points that have the optimal 3D arrangement of spatial uniformity. Extensive experiments demonstrated that our method outperforms conventional methods on large-scale datasets and with off-the-shelf cameras.

READ FULL TEXT

page 1

page 3

page 6

page 8

page 19

page 20

page 21

page 22

research
11/25/2021

Rethinking Generic Camera Models for Deep Single Image Camera Calibration to Recover Rotation and Fisheye Distortion

Although recent learning-based calibration methods can predict extrinsic...
research
04/13/2018

Pose estimation of a single circle using default intrinsic calibration

Circular markers are planar markers which offer great performances for d...
research
01/20/2020

Autocamera Calibration for traffic surveillance cameras with wide angle lenses

We propose a method for automatic calibration of a traffic surveillance ...
research
11/21/2019

Camera-to-Robot Pose Estimation from a Single Image

We present an approach for estimating the pose of a camera with respect ...
research
05/09/2021

Estimation of 3D Human Pose Using Prior Knowledge

Estimating three-dimensional human poses from the positions of two-dimen...
research
11/01/2021

Learning Eye-in-Hand Camera Calibration from a Single Image

Eye-in-hand camera calibration is a fundamental and long-studied problem...
research
12/23/2020

Direct Estimation of Spinal Cobb Angles by Structured Multi-Output Regression

The Cobb angle that quantitatively evaluates the spinal curvature plays ...

Please sign up or login with your details

Forgot password? Click here to reset