Deep Depth From Focus

04/04/2017
by   Caner Hazirbas, et al.
0

Depth from Focus (DFF) is one of the classical ill-posed inverse problems in computer vision. Most approaches recover the depth at each pixel based on the focal setting which exhibits maximal sharpness. Yet, it is not obvious how to reliably estimate the sharpness level, particularly in low-textured areas. In this paper, we propose `Deep Depth From Focus (DDFF)' as the first end-to-end learning approach to this problem. Towards this goal, we create a novel real-scene indoor benchmark composed of 4D light-field images obtained from a plenoptic camera and ground truth depth obtained from a registered RGB-D sensor. Compared to existing benchmarks our dataset is 25 times larger, enabling the use of machine learning for this inverse problem. We compare our results with state-of-the-art DFF methods and we also analyze the effect of several key deep architectural components. These experiments show that DDFFNet achieves state-of-the-art performance in all scenes, reducing depth error by more than 75

READ FULL TEXT

page 2

page 4

page 8

page 12

page 13

page 14

research
06/21/2019

Deep RGB-D Canonical Correlation Analysis For Sparse Depth Completion

In this paper, we propose our Correlation For Completion Network (CFCNet...
research
02/26/2022

Deep Depth from Focal Stack with Defocus Model for Camera-Setting Invariance

We propose a learning-based depth from focus/defocus (DFF), which takes ...
research
07/04/2016

A Two-Streamed Network for Estimating Fine-Scaled Depth Maps from Single RGB Images

Estimating depth from a single RGB image is an ill-posed and inherently ...
research
03/23/2020

Atlas: End-to-End 3D Scene Reconstruction from Posed Images

We present an end-to-end 3D reconstruction method for a scene by directl...
research
03/19/2016

Deep Shading: Convolutional Neural Networks for Screen-Space Shading

In computer vision, convolutional neural networks (CNNs) have recently a...
research
01/09/2019

Neural RGB->D Sensing: Depth and Uncertainty from a Video Camera

Depth sensing is crucial for 3D reconstruction and scene understanding. ...
research
03/30/2021

Physics-based Differentiable Depth Sensor Simulation

Gradient-based algorithms are crucial to modern computer-vision and grap...

Please sign up or login with your details

Forgot password? Click here to reset