Defocus Blur Detection via Depth Distillation

07/16/2020
by   Xiaodong Cun, et al.
0

Defocus Blur Detection(DBD) aims to separate in-focus and out-of-focus regions from a single image pixel-wisely. This task has been paid much attention since bokeh effects are widely used in digital cameras and smartphone photography. However, identifying obscure homogeneous regions and borderline transitions in partially defocus images is still challenging. To solve these problems, we introduce depth information into DBD for the first time. When the camera parameters are fixed, we argue that the accuracy of DBD is highly related to scene depth. Hence, we consider the depth information as the approximate soft label of DBD and propose a joint learning framework inspired by knowledge distillation. In detail, we learn the defocus blur from ground truth and the depth distilled from a well-trained depth estimation network at the same time. Thus, the sharp region will provide a strong prior for depth estimation while the blur detection also gains benefits from the distilled depth. Besides, we propose a novel decoder in the fully convolutional network(FCN) as our network structure. In each level of the decoder, we design the Selective Reception Field Block(SRFB) for merging multi-scale features efficiently and reuse the side outputs as Supervision-guided Attention Block(SAB). Unlike previous methods, the proposed decoder builds reception field pyramids and emphasizes salient regions simply and efficiently. Experiments show that our approach outperforms 11 other state-of-the-art methods on two popular datasets. Our method also runs at over 30 fps on a single GPU, which is 2x faster than previous works. The code is available at: https://github.com/vinthony/depth-distillation

READ FULL TEXT

page 2

page 5

page 6

page 7

page 9

page 11

page 13

page 14

research
06/20/2023

Depth and DOF Cues Make A Better Defocus Blur Detector

Defocus blur detection (DBD) separates in-focus and out-of-focus regions...
research
11/19/2020

Defocus Blur Detection via Salient Region Detection Prior

Defocus blur always occurred in photos when people take photos by Digita...
research
08/24/2021

Bridging Unsupervised and Supervised Depth from Focus via All-in-Focus Supervision

Depth estimation is a long-lasting yet important task in computer vision...
research
09/05/2018

Deep Depth from Defocus: how can defocus blur improve 3D estimation using dense neural networks?

Depth estimation is of critical interest for scene understanding and acc...
research
07/20/2022

Learning Depth from Focus in the Wild

For better photography, most recent commercial cameras including smartph...
research
11/30/2022

Attention-based Depth Distillation with 3D-Aware Positional Encoding for Monocular 3D Object Detection

Monocular 3D object detection is a low-cost but challenging task, as it ...
research
05/11/2018

PAD-Net: Multi-Tasks Guided Prediction-and-Distillation Network for Simultaneous Depth Estimation and Scene Parsing

Depth estimation and scene parsing are two particularly important tasks ...

Please sign up or login with your details

Forgot password? Click here to reset