Restoration of Video Frames from a Single Blurred Image with Motion Understanding

04/19/2021
by   Dawit Mureja Argaw, et al.
0

We propose a novel framework to generate clean video frames from a single motion-blurred image. While a broad range of literature focuses on recovering a single image from a blurred image, in this work, we tackle a more challenging task i.e. video restoration from a blurred image. We formulate video restoration from a single blurred image as an inverse problem by setting clean image sequence and their respective motion as latent factors, and the blurred image as an observation. Our framework is based on an encoder-decoder structure with spatial transformer network modules to restore a video sequence and its underlying motion in an end-to-end manner. We design a loss function and regularizers with complementary properties to stabilize the training and analyze variant models of the proposed network. The effectiveness and transferability of our network are highlighted through a large set of experiments on two different types of datasets: camera rotation blurs generated from panorama scenes and dynamic motion blurs in high speed videos.

READ FULL TEXT

page 3

page 4

page 7

page 8

research
03/04/2021

Motion-blurred Video Interpolation and Extrapolation

Abrupt motion of camera or objects in a scene result in a blurry video, ...
research
01/28/2022

Unfolding a blurred image

We present a solution for the goal of extracting a video from a single m...
research
04/09/2018

Bringing Alive Blurred Moments!

We present a solution for the novel goal of extracting a video from a si...
research
09/24/2021

MODNet-V: Improving Portrait Video Matting via Background Restoration

To address the challenging portrait video matting problem more precisely...
research
04/18/2021

Let's See Clearly: Contaminant Artifact Removal for Moving Cameras

Contaminants such as dust, dirt and moisture adhering to the camera lens...
research
05/21/2021

How Can I Swing Like Pro?: Golf Swing Analysis Tool for Self Training

In this work, we present an analysis tool to help golf beginners compare...
research
12/08/2020

Overcomplete Representations Against Adversarial Videos

Adversarial robustness of deep neural networks is an extensively studied...

Please sign up or login with your details

Forgot password? Click here to reset