EVREAL: Towards a Comprehensive Benchmark and Analysis Suite for Event-based Video Reconstruction

04/30/2023
by   Burak Ercan, et al.
0

Event cameras are a new type of vision sensor that incorporates asynchronous and independent pixels, offering advantages over traditional frame-based cameras such as high dynamic range and minimal motion blur. However, their output is not easily understandable by humans, making the reconstruction of intensity images from event streams a fundamental task in event-based vision. While recent deep learning-based methods have shown promise in video reconstruction from events, this problem is not completely solved yet. To facilitate comparison between different approaches, standardized evaluation protocols and diverse test datasets are essential. This paper proposes a unified evaluation methodology and introduces an open-source framework called EVREAL to comprehensively benchmark and analyze various event-based video reconstruction methods from the literature. Using EVREAL, we give a detailed analysis of the state-of-the-art methods for event-based video reconstruction, and provide valuable insights into the performance of these methods under varying settings, challenging scenarios, and downstream tasks.

READ FULL TEXT

page 4

page 7

page 15

page 16

page 17

research
04/24/2019

CED: Color Event Camera Dataset

Event cameras are novel, bio-inspired visual sensors, whose pixels outpu...
research
03/23/2022

Event-Based Dense Reconstruction Pipeline

Event cameras are a new type of sensors that are different from traditio...
research
03/02/2020

Learning to Deblur and Generate High Frame Rate Video with an Event Camera

Event cameras are bio-inspired cameras which can measure the change of i...
research
02/26/2019

Event-driven Video Frame Synthesis

Video frame synthesis is an active computer vision problem which has app...
research
09/23/2020

Unsupervised Feature Learning for Event Data: Direct vs Inverse Problem Formulation

Event-based cameras record an asynchronous stream of per-pixel brightnes...
research
09/03/2023

An Asynchronous Linear Filter Architecture for Hybrid Event-Frame Cameras

Event cameras are ideally suited to capture High Dynamic Range (HDR) vis...
research
06/09/2022

How Asynchronous Events Encode Video

As event-based sensing gains in popularity, theoretical understanding is...

Please sign up or login with your details

Forgot password? Click here to reset