Superevents: Towards Native Semantic Segmentation for Event-based Cameras

05/13/2021
by   Weng Fei Low, et al.
18

Most successful computer vision models transform low-level features, such as Gabor filter responses, into richer representations of intermediate or mid-level complexity for downstream visual tasks. These mid-level representations have not been explored for event cameras, although it is especially relevant to the visually sparse and often disjoint spatial information in the event stream. By making use of locally consistent intermediate representations, termed as superevents, numerous visual tasks ranging from semantic segmentation, visual tracking, depth estimation shall benefit. In essence, superevents are perceptually consistent local units that delineate parts of an object in a scene. Inspired by recent deep learning architectures, we present a novel method that employs lifetime augmentation for obtaining an event stream representation that is fed to a fully convolutional network to extract superevents. Our qualitative and quantitative experimental results on several sequences of a benchmark dataset highlights the significant potential for event-based downstream applications.

READ FULL TEXT

page 1

page 6

research
11/29/2018

EV-SegNet: Semantic Segmentation for Event-based Cameras

Event cameras, or Dynamic Vision Sensor (DVS), are very promising sensor...
research
09/04/2021

Dual Transfer Learning for Event-based End-task Prediction via Pluggable Event to Image Translation

Event cameras are novel sensors that perceive the per-pixel intensity ch...
research
04/04/2018

Event-based Vision meets Deep Learning on Steering Prediction for Self-driving Cars

Event cameras are bio-inspired vision sensors that naturally capture the...
research
07/21/2022

Multi-Event-Camera Depth Estimation and Outlier Rejection by Refocused Events Fusion

Event cameras are bio-inspired sensors that offer advantages over tradit...
research
05/27/2015

Improving Spatial Codification in Semantic Segmentation

This paper explores novel approaches for improving the spatial codificat...

Please sign up or login with your details

Forgot password? Click here to reset