Self-calibration-based Approach to Critical Motion Sequences of Rolling-shutter Structure from Motion

11/16/2016
by   Eisuke Ito, et al.
0

In this paper we consider critical motion sequences (CMSs) of rolling-shutter (RS) SfM. Employing an RS camera model with linearized pure rotation, we show that the RS distortion can be approximately expressed by two internal parameters of an "imaginary" camera plus one-parameter nonlinear transformation similar to lens distortion. We then reformulate the problem as self-calibration of the imaginary camera, in which its skew and aspect ratio are unknown and varying in the image sequence. In the formulation, we derive a general representation of CMSs. We also show that our method can explain the CMS that was recently reported in the literature, and then present a new remedy to deal with the degeneracy. Our theoretical results agree well with experimental results; it explains degeneracies observed when we employ naive bundle adjustment, and how they are resolved by our method.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/16/2021

Continuous-Time Spatiotemporal Calibration of a Rolling Shutter Camera-IMU System

The rolling shutter (RS) mechanism is widely used by consumer-grade came...
research
11/29/2016

Lens Distortion Rectification using Triangulation based Interpolation

Nonlinear lens distortion rectification is a common first step in image ...
research
03/12/2022

Bringing Rolling Shutter Images Alive with Dual Reversed Distortion

Rolling shutter (RS) distortion can be interpreted as the result of pick...
research
01/13/2022

Observability Analysis and Keyframe-Based Filtering for Visual Inertial Odometry with Full Self-Calibration

Camera-IMU (Inertial Measurement Unit) sensor fusion has been extensivel...
research
08/20/2020

Image Stitching and Rectification for Hand-Held Cameras

In this paper, we derive a new differential homography that can account ...
research
04/03/2022

Neural Global Shutter: Learn to Restore Video from a Rolling Shutter Camera with Global Reset Feature

Most computer vision systems assume distortion-free images as inputs. Th...
research
12/12/2021

Deep network for rolling shutter rectification

CMOS sensors employ row-wise acquisition mechanism while imaging a scene...

Please sign up or login with your details

Forgot password? Click here to reset