Breaking the Spatio-Angular Trade-off for Light Field Super-Resolution via LSTM Modelling on Epipolar Plane Images

02/15/2019
by   Mantang Guo, et al.
0

Light-field cameras (LFC) have received increasing attention due to their wide-spread applications. However, current LFCs suffer from the well-known spatio-angular trade-off, which is considered as an inherent and fundamental limit for LFC designs. In this paper, by doing a detailed geometrical optical analysis of the sampling process in an LFC, we show that the effective sampling resolution is generally higher than the number of micro-lenses. This contribution makes it theoretically possible to break the resolution trade-off. Our second contribution is an epipolar plane image (EPI) based super-resolution method, which can super-resolve the spatial and angular dimensions simultaneously. We prove that the light field is a 2D series, thus, a specifically designed CNN-LSTM network is proposed to capture the continuity property of the EPI. Rather than leveraging semantic information, our network focuses on extracting geometric continuity in the EPI. This gives our method an improved generalization ability and makes it applicable to a wide range of previously unseen scenes. Experiments on both synthetic and real light fields demonstrate the improvements over state-of-the-art, especially in large disparity areas.

READ FULL TEXT

page 1

page 4

page 6

page 7

page 8

research
12/17/2019

Spatial-Angular Interaction for Light Field Image Super-Resolution

Light field (LF) cameras record both intensity and directions of light r...
research
08/08/2021

Efficient Light Field Reconstruction via Spatio-Angular Dense Network

As an image sensing instrument, light field images can supply extra angu...
research
09/27/2018

A Simple Framework to Leverage State-Of-The-Art Single-Image Super-Resolution Methods to Restore Light Fields

Plenoptic cameras offer a cost effective solution to capture light field...
research
02/22/2022

Disentangling Light Fields for Super-Resolution and Disparity Estimation

Light field (LF) cameras record both intensity and directions of light r...
research
01/12/2018

Light Field Super-Resolution using a Low-Rank Prior and Deep Convolutional Neural Networks

Light field imaging has recently known a regain of interest due to the a...
research
01/02/2022

Detail-Preserving Transformer for Light Field Image Super-Resolution

Recently, numerous algorithms have been developed to tackle the problem ...
research
04/02/2022

Optical modelling of accommodative light field display system and prediction of human eye responses

The spatio-angular resolution of a light field (LF) display is a crucial...

Please sign up or login with your details

Forgot password? Click here to reset