Bringing Blurry Alive at High Frame-Rate with an Event Camera

03/12/2019
by   Liyuan Pan, et al.
6

Event-based cameras can measure intensity changes (called ` events') with microsecond accuracy under high-speed motion and challenging lighting conditions. With the active pixel sensor (APS), the event camera allows simultaneous output of the intensity frames. However, the output images are captured at a relatively low frame-rate and often suffer from motion blur. A blurry image can be regarded as the integral of a sequence of latent images, while the events indicate the changes between the latent images. Therefore, we are able to model the blur-generation process by associating event data to a latent image. Based on the abundant event data and the low frame-rate easily blurred images, we propose a simple and effective approach to reconstruct a high-quality and high frame-rate shape video. Starting with a single blurry frame and its event data, we propose the Event-based Double Integral (EDI) model. Then, we extend it to multiple Event-based Double Integral (mEDI) model to get more smooth and convincing results based on multiple images and their events. We also provide an efficient solver to minimize the proposed energy model. By optimizing the energy model, we achieve significant improvements in removing general blurs and reconstructing high temporal resolution video. The video generation is based on solving a simple non-convex optimization problem in a single scalar variable. Experimental results on both synthetic and real images demonstrate the superiority of our mEDI model and optimization method in comparison to the state-of-the-art.

READ FULL TEXT

page 2

page 4

page 5

page 7

page 8

page 9

page 10

page 11

research
11/26/2018

Bringing a Blurry Frame Alive at High Frame-Rate with an Event Camera

Event-based cameras can measure intensity changes (called ` events') wit...
research
05/10/2023

Fast Event-based Double Integral for Real-time Robotics

Motion deblurring is a critical ill-posed problem that is important in m...
research
01/17/2023

Event-based Shape from Polarization

State-of-the-art solutions for Shape-from-Polarization (SfP) suffer from...
research
04/01/2020

Single Image Optical Flow Estimation with an Event Camera

Event cameras are bio-inspired sensors that asynchronously report intens...
research
05/16/2018

Photorealistic Image Reconstruction from Hybrid Intensity and Event based Sensor

Event based sensors encode pixel wise contrast changes as positive or ne...
research
08/24/2022

Event-based Image Deblurring with Dynamic Motion Awareness

Non-uniform image deblurring is a challenging task due to the lack of te...
research
06/24/2022

Ev-NeRF: Event Based Neural Radiance Field

We present Ev-NeRF, a Neural Radiance Field derived from event data. Whi...

Please sign up or login with your details

Forgot password? Click here to reset