EventMix: An Efficient Augmentation Strategy for Event-Based Data

05/24/2022
by   Guobin Shen, et al.
10

High-quality and challenging event stream datasets play an important role in the design of an efficient event-driven mechanism that mimics the brain. Although event cameras can provide high dynamic range and low-energy event stream data, the scale is smaller and more difficult to obtain than traditional frame-based data, which restricts the development of neuromorphic computing. Data augmentation can improve the quantity and quality of the original data by processing more representations from the original data. This paper proposes an efficient data augmentation strategy for event stream data: EventMix. We carefully design the mixing of different event streams by Gaussian Mixture Model to generate random 3D masks and achieve arbitrary shape mixing of event streams in the spatio-temporal dimension. By computing the relative distances of event streams, we propose a more reasonable way to assign labels to the mixed samples. The experimental results on multiple neuromorphic datasets have shown that our strategy can improve its performance on neuromorphic datasets both for ANNs and SNNs, and we have achieved state-of-the-art performance on DVS-CIFAR10, N-Caltech101, N-CARS, and DVS-Gesture datasets.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/23/2021

ES-ImageNet: A Million Event-Stream Classification Dataset for Spiking Neural Networks

With event-driven algorithms, especially the spiking neural networks (SN...
research
02/14/2021

Naturalizing Neuromorphic Vision Event Streams Using GANs

Dynamic vision sensors are able to operate at high temporal resolutions ...
research
03/11/2022

Neuromorphic Data Augmentation for Training Spiking Neural Networks

Developing neuromorphic intelligence on event-based datasets with spikin...
research
04/28/2020

Event-based Robotic Grasping Detection with Neuromorphic Vision Sensor and Event-Stream Dataset

Robotic grasping plays an important role in the field of robotics. The c...
research
05/12/2021

Removing Blocking Artifacts in Video Streams Using Event Cameras

In this paper, we propose EveRestNet, a convolutional neural network des...
research
01/28/2022

Benchmarking Conventional Vision Models on Neuromorphic Fall Detection and Action Recognition Dataset

Neuromorphic vision-based sensors are gaining popularity in recent years...
research
02/26/2020

Inceptive Event Time-Surfaces for Object Classification Using Neuromorphic Cameras

This paper presents a novel fusion of low-level approaches for dimension...

Please sign up or login with your details

Forgot password? Click here to reset