Improved Regularization of Event-based Learning by Reversing and Drifting

07/24/2022
by   Haibo Shen, et al.
0

Event camera has an enormous potential in challenging scenes for its advantages of high temporal resolution, high dynamic range, low power consumption, and no motion blur. However, event-based learning is hindered by insufficient generalization ability. In this paper, we first analyze the influence of different brightness variations on event data. Then we propose two novel augmentation methods: EventReverse and EventDrift. By reversing and drifting events to their corresponding positions in the spatiotemporal or polarity domain, the proposed methods generate samples affected by different brightness variations, which improves the robustness of event-based learning and results in a better generalization. Extensive experiments on N-CARS, N-Caltech101 and CIFAR10-DVS datasets demonstrate that our method is general and remarkably effective.

READ FULL TEXT
research
06/07/2021

EventDrop: data augmentation for event-based learning

The advantages of event-sensing over conventional sensors (e.g., higher ...
research
03/14/2023

Training Robust Spiking Neural Networks with ViewPoint Transform and SpatioTemporal Stretching

Neuromorphic vision sensors (event cameras) simulate biological visual p...
research
03/22/2021

AET-EFN: A Versatile Design for Static and Dynamic Event-Based Vision

The neuromorphic event cameras, which capture the optical changes of a s...
research
02/28/2023

Tracking Fast by Learning Slow: An Event-based Speed Adaptive Hand Tracker Leveraging Knowledge in RGB Domain

3D hand tracking methods based on monocular RGB videos are easily affect...
research
02/18/2019

Motion Equivariant Networks for Event Cameras with the Temporal Normalization Transform

In this work, we propose a novel transformation for events from an event...
research
04/11/2022

Event Transformer

The event camera is a bio-vision inspired camera with high dynamic range...
research
10/05/2021

Multi-axis Attentive Prediction for Sparse EventData: An Application to Crime Prediction

Spatiotemporal prediction of event data is a challenging task with a lon...

Please sign up or login with your details

Forgot password? Click here to reset