Attention Mechanisms for Object Recognition with Event-Based Cameras

07/25/2018
by   Marco Cannici, et al.
6

Event-based cameras are neuromorphic sensors capable of efficiently encoding visual information in the form of sparse sequences of events. Being biologically inspired, they are commonly used to exploit some of the computational and power consumption benefits of biological vision. In this paper we focus on a specific feature of vision: visual attention. We propose two attentive models for event based vision. An algorithm that tracks events activity within the field of view to locate regions of interest and a fully-differentiable attention procedure based on DRAW neural model. We highlight the strengths and weaknesses of the proposed methods on two datasets, the Shifted N-MNIST and Shifted MNIST-DVS collections, using the Phased LSTM recognition network as a baseline reference model obtaining improvements in terms of both translation and scale invariance.

READ FULL TEXT

page 4

page 5

page 6

page 8

research
04/17/2019

Event-based Vision: A Survey

Event cameras are bio-inspired sensors that work radically different fro...
research
05/21/2018

Event-based Convolutional Networks for Object Detection in Neuromorphic Cameras

Event-based cameras are bioinspired sensors able to perceive changes in ...
research
10/30/2017

DART: Distribution Aware Retinal Transform for Event-based Cameras

We introduce a new event-based visual descriptor, termed as distribution...
research
03/19/2019

Pose-Invariant Object Recognition for Event-Based Vision with Slow-ELM

Neuromorphic image sensors produce activity-driven spiking output at eve...
research
06/08/2008

Fast Wavelet-Based Visual Classification

We investigate a biologically motivated approach to fast visual classifi...
research
05/10/2021

Event-LSTM: An Unsupervised and Asynchronous Learning-based Representation for Event-based Data

Event cameras are activity-driven bio-inspired vision sensors, thereby r...
research
04/15/2016

Invariant feature extraction from event based stimuli

We propose a novel architecture, the event-based GASSOM for learning and...

Please sign up or login with your details

Forgot password? Click here to reset