Efficient Light Field Reconstruction via Spatio-Angular Dense Network

08/08/2021
by   Zexi Hu, et al.
0

As an image sensing instrument, light field images can supply extra angular information compared with monocular images and have facilitated a wide range of measurement applications. Light field image capturing devices usually suffer from the inherent trade-off between the angular and spatial resolutions. To tackle this problem, several methods, such as light field reconstruction and light field super-resolution, have been proposed but leaving two problems unaddressed, namely domain asymmetry and efficient information flow. In this paper, we propose an end-to-end Spatio-Angular Dense Network (SADenseNet) for light field reconstruction with two novel components, namely correlation blocks and spatio-angular dense skip connections to address them. The former performs effective modeling of the correlation information in a way that conforms with the domain asymmetry. And the latter consists of three kinds of connections enhancing the information flow within two domains. Extensive experiments on both real-world and synthetic datasets have been conducted to demonstrate that the proposed SADenseNet's state-of-the-art performance at significantly reduced costs in memory and computation. The qualitative results show that the reconstructed light field images are sharp with correct details and can serve as pre-processing to improve the accuracy of related measurement applications.

READ FULL TEXT

page 1

page 2

page 4

page 8

page 9

page 11

page 12

page 14

research
11/23/2019

Joint Spatial and Angular Super-Resolution from a Single Image

Synthesizing a densely sampled light field from a single image is highly...
research
02/15/2019

Breaking the Spatio-Angular Trade-off for Light Field Super-Resolution via LSTM Modelling on Epipolar Plane Images

Light-field cameras (LFC) have received increasing attention due to thei...
research
10/14/2019

Light Field Synthesis by Training Deep Network in the Refocused Image Domain

Light field imaging, which captures spatio-angular information of incide...
research
03/29/2020

High-Order Residual Network for Light Field Super-Resolution

Plenoptic cameras usually sacrifice the spatial resolution of their SAIs...
research
02/17/2019

LapEPI-Net: A Laplacian Pyramid EPI structure for Learning-based Dense Light Field Reconstruction

For dense sampled light field (LF) reconstruction problem, existing appr...
research
08/15/2016

Intrinsic Light Field Images

We present a method to automatically decompose a light field into its in...
research
09/05/2020

Deep Sparse Light Field Refocusing

Light field photography enables to record 4D images, containing angular ...

Please sign up or login with your details

Forgot password? Click here to reset