Light field Rectification based on relative pose estimation

01/29/2022
by   Xiao Huo, et al.
6

Hand-held light field (LF) cameras have unique advantages in computer vision such as 3D scene reconstruction and depth estimation. However, the related applications are limited by the ultra-small baseline, e.g., leading to the extremely low depth resolution in reconstruction. To solve this problem, we propose to rectify LF to obtain a large baseline. Specifically, the proposed method aligns two LFs captured by two hand-held LF cameras with a random relative pose, and extracts the corresponding row-aligned sub-aperture images (SAIs) to obtain an LF with a large baseline. For an accurate rectification, a method for pose estimation is also proposed, where the relative rotation and translation between the two LF cameras are estimated. The proposed pose estimation minimizes the degree of freedom (DoF) in the LF-point-LF-point correspondence model and explicitly solves this model in a linear way. The proposed pose estimation outperforms the state-of-the-art algorithms by providing more accurate results to support rectification. The significantly improved depth resolution in 3D reconstruction demonstrates the effectiveness of the proposed LF rectification.

READ FULL TEXT

page 2

page 3

page 11

page 12

page 14

page 15

page 16

research
08/11/2017

Pose Guided Structured Region Ensemble Network for Cascaded Hand Pose Estimation

Hand pose estimation from a single depth image is an essential topic in ...
research
03/03/2019

Hand Pose Estimation: A Survey

The success of Deep Convolutional Neural Networks (CNNs) in recent years...
research
12/01/2017

Inertial-aided Rolling Shutter Relative Pose Estimation

Relative pose estimation is a fundamental problem in computer vision and...
research
08/01/2019

A Framework for Depth Estimation and Relative Localization of Ground Robots using Computer Vision

The 3D depth estimation and relative pose estimation problem within a de...
research
10/13/2018

Equivalent Constraints for Two-View Geometry: Pose Solution/Pure Rotation Identification and 3D Reconstruction

Two-view relative pose estimation and structure reconstruction is a clas...
research
05/10/2021

Galois/monodromy groups for decomposing minimal problems in 3D reconstruction

We consider Galois/monodromy groups arising in computer vision applicati...
research
12/28/2018

Enhanced Touchable Projector-depth System with Deep Hand Pose Estimation

Touchable projection with structured light range cameras is a prolific m...

Please sign up or login with your details

Forgot password? Click here to reset