Motion Deblurring with Real Events

09/28/2021
by   Fang Xu, et al.
0

In this paper, we propose an end-to-end learning framework for event-based motion deblurring in a self-supervised manner, where real-world events are exploited to alleviate the performance degradation caused by data inconsistency. To achieve this end, optical flows are predicted from events, with which the blurry consistency and photometric consistency are exploited to enable self-supervision on the deblurring network with real-world data. Furthermore, a piece-wise linear motion model is proposed to take into account motion non-linearities and thus leads to an accurate model for the physical formation of motion blurs in the real-world scenario. Extensive evaluation on both synthetic and real motion blur datasets demonstrates that the proposed algorithm bridges the gap between simulated and real-world motion blurs and shows remarkable performance for event-based motion deblurring in real-world scenarios.

READ FULL TEXT

page 1

page 4

page 6

page 8

research
08/11/2023

Generalizing Event-Based Motion Deblurring in Real-World Scenarios

Event-based motion deblurring has shown promising results by exploiting ...
research
03/23/2022

Unifying Motion Deblurring and Frame Interpolation with Events

Slow shutter speed and long exposure time of frame-based cameras often c...
research
04/14/2023

Self-Supervised Scene Dynamic Recovery from Rolling Shutter Images and Events

Scene Dynamic Recovery (SDR) by inverting distorted Rolling Shutter (RS)...
research
09/15/2019

Query-Focused Scenario Construction

The news coverage of events often contains not one but multiple incompat...
research
02/10/2020

Self-Supervised Linear Motion Deblurring

Motion blurry images challenge many computer vision algorithms, e.g, fea...
research
04/13/2020

Learning Event-Based Motion Deblurring

Recovering sharp video sequence from a motion-blurred image is highly il...
research
11/06/2021

Neural Implicit Event Generator for Motion Tracking

We present a novel framework of motion tracking from event data using im...

Please sign up or login with your details

Forgot password? Click here to reset