Event-based Vision: A Survey

04/17/2019
by   Guillermo Gallego, et al.
18

Event cameras are bio-inspired sensors that work radically different from traditional cameras. Instead of capturing images at a fixed rate, they measure per-pixel brightness changes asynchronously. This results in a stream of events, which encode the time, location and sign of the brightness changes. Event cameras posses outstanding properties compared to traditional cameras: very high dynamic range (140 dB vs. 60 dB), high temporal resolution (in the order of microseconds), low power consumption, and do not suffer from motion blur. Hence, event cameras have a large potential for robotics and computer vision in challenging scenarios for traditional cameras, such as high speed and high dynamic range. However, novel methods are required to process the unconventional output of these sensors in order to unlock their potential. This paper provides a comprehensive overview of the emerging field of event-based vision, with a focus on the applications and the algorithms developed to unlock the outstanding properties of event cameras. We present event cameras from their working principle, the actual sensors that are available and the tasks that they have been used for, from low-level vision (feature detection and tracking, optic flow, etc.) to high-level vision (reconstruction, segmentation, recognition). We also discuss the techniques developed to process events, including learning-based techniques, as well as specialized processors for these novel sensors, such as spiking neural networks. Additionally, we highlight the challenges that remain to be tackled and the opportunities that lie ahead in the search for a more efficient, bio-inspired way for machines to perceive and interact with the world.

READ FULL TEXT

page 2

page 8

page 10

page 11

page 13

page 14

page 15

page 18

research
04/17/2019

Events-to-Video: Bringing Modern Computer Vision to Event Cameras

Event cameras are novel sensors that report brightness changes in the fo...
research
05/03/2020

Quadtree Driven Lossy Event Compression

Event cameras are emerging bio-inspired sensors that offer salient benef...
research
02/17/2023

Deep Learning for Event-based Vision: A Comprehensive Survey and Benchmarks

Event cameras are bio-inspired sensors that capture the per-pixel intens...
research
03/22/2021

AET-EFN: A Versatile Design for Static and Dynamic Event-Based Vision

The neuromorphic event cameras, which capture the optical changes of a s...
research
09/10/2022

Real-time event simulation with frame-based cameras

Event cameras are becoming increasingly popular in robotics and computer...
research
07/25/2018

Attention Mechanisms for Object Recognition with Event-Based Cameras

Event-based cameras are neuromorphic sensors capable of efficiently enco...
research
09/11/2023

A Comparison between Frame-based and Event-based Cameras for Flapping-Wing Robot Perception

Perception systems for ornithopters face severe challenges. The harsh vi...

Please sign up or login with your details

Forgot password? Click here to reset