DeepAI AI Chat
Log In Sign Up

Dynamic Fusion Network For Light Field Depth Estimation

by   Yongri Piao, et al.

Focus based methods have shown promising results for the task of depth estimation. However, most existing focus based depth estimation approaches depend on maximal sharpness of the focal stack. Out of focus information in the focal stack poses challenges for this task. In this paper, we propose a dynamically multi modal learning strategy which incorporates RGB data and the focal stack in our framework. Our goal is to deeply excavate the spatial correlation in the focal stack by designing the spatial correlation perception module and dynamically fuse multi modal information between RGB data and the focal stack in a adaptive way by designing the multi modal dynamic fusion module. The success of our method is demonstrated by achieving the state of the art performance on two datasets. Furthermore, we test our network on a set of different focused images generated by a smart phone camera to prove that the proposed method not only broke the limitation of only using light field data, but also open a path toward practical applications of depth estimation on common consumer level cameras data.


page 2

page 5

page 7

page 10

page 13

page 14


Learning Multi-modal Information for Robust Light Field Depth Estimation

Light field data has been demonstrated to facilitate the depth estimatio...

Deep Depth from Focal Stack with Defocus Model for Camera-Setting Invariance

We propose a learning-based depth from focus/defocus (DFF), which takes ...

Beyond Image to Depth: Improving Depth Prediction using Echoes

We address the problem of estimating depth with multi modal audio visual...

The Application of Preconditioned Alternating Direction Method of Multipliers in Depth from Focal Stack

Post capture refocusing effect in smartphone cameras is achievable by us...

Deep Anti-aliasing of Whole Focal Stack Using its Slice Spectrum

The paper aims at removing the aliasing effects for the whole focal stac...

Light Field Saliency Detection with Dual Local Graph Learning andReciprocative Guidance

The application of light field data in salient object de-tection is beco...

Deep Depth from Focus with Differential Focus Volume

Depth-from-focus (DFF) is a technique that infers depth using the focus ...