Generalizing Event-Based Motion Deblurring in Real-World Scenarios

08/11/2023
by   Xiang Zhang, et al.
1

Event-based motion deblurring has shown promising results by exploiting low-latency events. However, current approaches are limited in their practical usage, as they assume the same spatial resolution of inputs and specific blurriness distributions. This work addresses these limitations and aims to generalize the performance of event-based deblurring in real-world scenarios. We propose a scale-aware network that allows flexible input spatial scales and enables learning from different temporal scales of motion blur. A two-stage self-supervised learning scheme is then developed to fit real-world data distribution. By utilizing the relativity of blurriness, our approach efficiently ensures the restored brightness and structure of latent images and further generalizes deblurring performance to handle varying spatial and temporal scales of motion blur in a self-distillation manner. Our method is extensively evaluated, demonstrating remarkable performance, and we also introduce a real-world dataset consisting of multi-scale blurry frames and events to facilitate research in event-based deblurring.

READ FULL TEXT

page 1

page 6

page 7

page 9

research
09/28/2021

Motion Deblurring with Real Events

In this paper, we propose an end-to-end learning framework for event-bas...
research
03/23/2022

Unifying Motion Deblurring and Frame Interpolation with Events

Slow shutter speed and long exposure time of frame-based cameras often c...
research
03/24/2023

Learning Spatial-Temporal Implicit Neural Representations for Event-Guided Video Super-Resolution

Event cameras sense the intensity changes asynchronously and produce eve...
research
11/21/2022

Blur Interpolation Transformer for Real-World Motion from Blur

This paper studies the challenging problem of recovering motion from blu...
research
02/14/2023

Event-guided Multi-patch Network with Self-supervision for Non-uniform Motion Deblurring

Contemporary deep learning multi-scale deblurring models suffer from man...
research
02/12/2013

Latent Self-Exciting Point Process Model for Spatial-Temporal Networks

We propose a latent self-exciting point process model that describes geo...
research
04/14/2023

Self-Supervised Scene Dynamic Recovery from Rolling Shutter Images and Events

Scene Dynamic Recovery (SDR) by inverting distorted Rolling Shutter (RS)...

Please sign up or login with your details

Forgot password? Click here to reset