E-CIR: Event-Enhanced Continuous Intensity Recovery

03/03/2022
by   Chen Song, et al.
1

A camera begins to sense light the moment we press the shutter button. During the exposure interval, relative motion between the scene and the camera causes motion blur, a common undesirable visual artifact. This paper presents E-CIR, which converts a blurry image into a sharp video represented as a parametric function from time to intensity. E-CIR leverages events as an auxiliary input. We discuss how to exploit the temporal event structure to construct the parametric bases. We demonstrate how to train a deep learning model to predict the function coefficients. To improve the appearance consistency, we further introduce a refinement module to propagate visual features among consecutive frames. Compared to state-of-the-art event-enhanced deblurring approaches, E-CIR generates smoother and more realistic results. The implementation of E-CIR is available at https://github.com/chensong1995/E-CIR.

READ FULL TEXT

page 7

page 10

page 11

page 12

page 13

research
06/13/2020

V2E: From video frames to realistic DVS event camera streams

To help meet the increasing need for dynamic vision sensor (DVS) event c...
research
03/15/2023

DeblurSR: Event-Based Motion Deblurring Under the Spiking Representation

We present DeblurSR, a novel motion deblurring approach that converts a ...
research
02/27/2023

Learning to Super-Resolve Blurry Images with Events

Super-Resolution from a single motion Blurred image (SRB) is a severely ...
research
12/13/2021

Event-guided Deblurring of Unknown Exposure Time Videos

Video deblurring is a highly ill-posed problem due to the loss of motion...
research
09/13/2023

Aggregating Long-term Sharp Features via Hybrid Transformers for Video Deblurring

Video deblurring methods, aiming at recovering consecutive sharp frames ...
research
03/20/2023

Bimodal SegNet: Instance Segmentation Fusing Events and RGB Frames for Robotic Grasping

Object segmentation for robotic grasping under dynamic conditions often ...
research
04/20/2021

Comparing Representations in Tracking for Event Camera-based SLAM

This paper investigates two typical image-type representations for event...

Please sign up or login with your details

Forgot password? Click here to reset