Deep Multi-scale Convolutional Neural Network for Dynamic Scene Deblurring

12/07/2016
by   Seungjun Nah, et al.
0

Non-uniform blind deblurring for general dynamic scenes is a challenging computer vision problem since blurs are caused by camera shake, scene depth as well as multiple object motions. To remove these complicated motion blurs, conventional energy optimization based methods rely on simple assumptions such that blur kernel is partially uniform or locally linear. Moreover, recent machine learning based methods also depend on synthetic blur datasets generated under these assumptions. This makes conventional deblurring methods fail to remove blurs where blur kernel is difficult to approximate or parameterize (e.g. object motion boundaries). In this work, we propose a multi-scale convolutional neural network that restores blurred images caused by various sources in an end-to-end manner. Furthermore, we present multi-scale loss function that mimics conventional coarse-to-fine approaches. Moreover, we propose a new large scale dataset that provides pairs of realistic blurry image and the corresponding ground truth sharp image that are obtained by a high-speed camera. With the proposed model trained on this dataset, we demonstrate empirically that our method achieves the state-of-the-art performance in dynamic scene deblurring not only qualitatively, but also quantitatively.

READ FULL TEXT

page 7

page 11

page 12

page 14

page 15

page 17

page 20

page 21

research
07/11/2019

Edge Heuristic GAN for Non-uniform Blind Deblurring

Non-uniform blur, mainly caused by camera shake and motions of multiple ...
research
11/19/2019

Deep Motion Blur Removal Using Noisy/Blurry Image Pairs

Removing spatially variant motion blur from a blurry image is a challeng...
research
04/05/2020

Deep Homography Estimation for Dynamic Scenes

Homography estimation is an important step in many computer vision probl...
research
02/06/2018

Scale-recurrent Network for Deep Image Deblurring

In single image deblurring, the "coarse-to-fine" scheme, i.e. gradually ...
research
03/14/2016

Dynamic Scene Deblurring using a Locally Adaptive Linear Blur Model

State-of-the-art video deblurring methods cannot handle blurry videos re...
research
01/18/2023

Deep Dynamic Scene Deblurring from Optical Flow

Deblurring can not only provide visually more pleasant pictures and make...
research
11/29/2016

Occlusion-Aware Video Deblurring with a New Layered Blur Model

We present a deblurring method for scenes with occluding objects using a...

Please sign up or login with your details

Forgot password? Click here to reset