High-dimensional Dense Residual Convolutional Neural Network for Light Field Reconstruction

10/03/2019
by   Nan Meng, et al.
15

We consider the problem of high-dimensional light field reconstruction and develop a learning-based framework for spatial and angular super-resolution. Many current approaches either require disparity clues or restore the spatial and angular details separately. Such methods have difficulties with non-Lambertian surfaces or occlusions. In contrast, we formulate light field super-resolution (LFSR) as tensor restoration and develop a learning framework based on a two-stage restoration with 4-dimensional (4D) convolution. This allows our model to learn the features capturing the geometry information encoded in multiple adjacent views. Such geometric features vary near the occlusion regions and indicate the foreground object border. To train a feasible network, we propose a novel normalization operation based on a group of views in the feature maps, design a stage-wise loss function, and develop the multi-range training strategy to further improve the performance. Evaluations are conducted on a number of light field datasets including real-world scenes, synthetic data, and microscope light fields. The proposed method achieves superior performance and less execution time comparing with other state-of-the-art schemes.

READ FULL TEXT

page 4

page 6

page 7

page 9

page 11

page 12

research
01/02/2022

Detail-Preserving Transformer for Light Field Image Super-Resolution

Recently, numerous algorithms have been developed to tackle the problem ...
research
03/24/2021

Light Field Reconstruction Using Convolutional Network on EPI and Extended Applications

In this paper, a novel convolutional neural network (CNN)-based framewor...
research
03/29/2020

High-Order Residual Network for Light Field Super-Resolution

Plenoptic cameras usually sacrifice the spatial resolution of their SAIs...
research
08/26/2020

Multi-Dimension Fusion Network for Light Field Spatial Super-Resolution using Dynamic Filters

Light field cameras have been proved to be powerful tools for 3D reconst...
research
01/12/2018

Light Field Super-Resolution using a Low-Rank Prior and Deep Convolutional Neural Networks

Light field imaging has recently known a regain of interest due to the a...
research
08/11/2020

A Study of Efficient Light Field Subsampling and Reconstruction Strategies

Limited angular resolution is one of the main obstacles for practical ap...
research
05/13/2020

Generative Models for Generic Light Field Reconstruction

Recently deep generative models have achieved impressive progress in mod...

Please sign up or login with your details

Forgot password? Click here to reset