Graph-based Asynchronous Event Processing for Rapid Object Recognition

08/28/2023
by   Yijin Li, et al.
0

Different from traditional video cameras, event cameras capture asynchronous events stream in which each event encodes pixel location, trigger time, and the polarity of the brightness changes. In this paper, we introduce a novel graph-based framework for event cameras, namely SlideGCN. Unlike some recent graph-based methods that use groups of events as input, our approach can efficiently process data event-by-event, unlock the low latency nature of events data while still maintaining the graph's structure internally. For fast graph construction, we develop a radius search algorithm, which better exploits the partial regular structure of event cloud against k-d tree based generic methods. Experiments show that our method reduces the computational complexity up to 100 times with respect to current graph-based methods while keeping state-of-the-art performance on object recognition. Moreover, we verify the superiority of event-wise processing with our method. When the state becomes stable, we can give a prediction with high confidence, thus making an early recognition. Project page: <https://zju3dv.github.io/slide_gcn/>.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/20/2020

Event-based Asynchronous Sparse Convolutional Networks

Event cameras are bio-inspired sensors that respond to per-pixel brightn...
research
06/13/2018

Graph-Based Decoding for Event Sequencing and Coreference Resolution

Events in text documents are interrelated in complex ways. In this paper...
research
11/22/2022

Pushing the Limits of Asynchronous Graph-based Object Detection with Event Cameras

State-of-the-art machine-learning methods for event cameras treat events...
research
09/23/2020

Unsupervised Feature Learning for Event Data: Direct vs Inverse Problem Formulation

Event-based cameras record an asynchronous stream of per-pixel brightnes...
research
06/01/2021

EV-VGCNN: A Voxel Graph CNN for Event-based Object Classification

Event cameras report sparse intensity changes and hold noticeable advant...
research
03/23/2022

Ev-TTA: Test-Time Adaptation for Event-Based Object Recognition

We introduce Ev-TTA, a simple, effective test-time adaptation algorithm ...
research
01/27/2021

e-ACJ: Accurate Junction Extraction For Event Cameras

Junctions reflect the important geometrical structure information of the...

Please sign up or login with your details

Forgot password? Click here to reset