Defocus Map Estimation and Deblurring from a Single Dual-Pixel Image

10/12/2021
by   Shumian Xin, et al.
0

We present a method that takes as input a single dual-pixel image, and simultaneously estimates the image's defocus map – the amount of defocus blur at each pixel – and recovers an all-in-focus image. Our method is inspired from recent works that leverage the dual-pixel sensors available in many consumer cameras to assist with autofocus, and use them for recovery of defocus maps or all-in-focus images. These prior works have solved the two recovery problems independently of each other, and often require large labeled datasets for supervised training. By contrast, we show that it is beneficial to treat these two closely-connected problems simultaneously. To this end, we set up an optimization problem that, by carefully modeling the optics of dual-pixel images, jointly solves both problems. We use data captured with a consumer smartphone camera to demonstrate that, after a one-time calibration step, our approach improves upon prior works for both defocus map estimation and blur removal, despite being entirely unsupervised.

READ FULL TEXT

page 2

page 3

page 7

page 8

page 12

page 13

page 18

page 19

research
05/01/2020

Defocus Deblurring Using Dual-Pixel Data

Defocus blur arises in images that are captured with a shallow depth of ...
research
07/19/2023

LDP: Language-driven Dual-Pixel Image Defocus Deblurring Network

Recovering sharp images from dual-pixel (DP) pairs with disparity-depend...
research
11/25/2022

Learnable Blur Kernel for Single-Image Defocus Deblurring in the Wild

Recent research showed that the dual-pixel sensor has made great progres...
research
04/01/2020

Single Image Optical Flow Estimation with an Event Camera

Event cameras are bio-inspired sensors that asynchronously report intens...
research
12/11/2020

Mesoscopic photogrammetry with an unstabilized phone camera

We present a feature-free photogrammetric technique that enables quantit...
research
11/02/2019

DeepBlindness: Fast Blindness Map Estimation and Blindness Type Classification for Outdoor Scene from Single Color Image

Outdoor vision robotic systems and autonomous cars suffer from many imag...
research
12/06/2020

Learning to Reduce Defocus Blur by Realistically Modeling Dual-Pixel Data

Recent work has shown impressive results on data-driven defocus deblurri...

Please sign up or login with your details

Forgot password? Click here to reset