Bridging Unsupervised and Supervised Depth from Focus via All-in-Focus Supervision

08/24/2021
by   Ning-Hsu Wang, et al.
11

Depth estimation is a long-lasting yet important task in computer vision. Most of the previous works try to estimate depth from input images and assume images are all-in-focus (AiF), which is less common in real-world applications. On the other hand, a few works take defocus blur into account and consider it as another cue for depth estimation. In this paper, we propose a method to estimate not only a depth map but an AiF image from a set of images with different focus positions (known as a focal stack). We design a shared architecture to exploit the relationship between depth and AiF estimation. As a result, the proposed method can be trained either supervisedly with ground truth depth, or unsupervisedly with AiF images as supervisory signals. We show in various experiments that our method outperforms the state-of-the-art methods both quantitatively and qualitatively, and also has higher efficiency in inference time.

READ FULL TEXT

page 4

page 6

page 7

page 8

research
03/19/2023

Fully Self-Supervised Depth Estimation from Defocus Clue

Depth-from-defocus (DFD), modeling the relationship between depth and de...
research
05/25/2019

Unsupervised Single Image Underwater Depth Estimation

Depth estimation from a single underwater image is one of the most chall...
research
11/24/2021

MonoPLFlowNet: Permutohedral Lattice FlowNet for Real-Scale 3D Scene FlowEstimation with Monocular Images

Real-scale scene flow estimation has become increasingly important for 3...
research
06/20/2023

Depth and DOF Cues Make A Better Defocus Blur Detector

Defocus blur detection (DBD) separates in-focus and out-of-focus regions...
research
07/16/2020

Defocus Blur Detection via Depth Distillation

Defocus Blur Detection(DBD) aims to separate in-focus and out-of-focus r...
research
12/27/2021

Depth estimation of endoscopy using sim-to-real transfer

In order to use the navigation system effectively, distance information ...
research
03/08/2023

Aberration-Aware Depth-from-Focus

Computer vision methods for depth estimation usually use simple camera m...

Please sign up or login with your details

Forgot password? Click here to reset