EventPoint: Self-Supervised Local Descriptor Learning for Event Cameras

09/01/2021
by   Ze Huang, et al.
4

We proposes a method of extracting intrest points and descriptors using self-supervised learning method on frame-based event data, which is called EventPoint. Different from other feature extraction methods on event data, we train our model on real event-form driving dataset–DSEC with the self-supervised learning method we proposed, the training progress fully consider the characteristics of event data.To verify the effectiveness of our work,we conducted several complete evaluations: we emulated DART and carried out feature matching experiments on N-caltech101 dataset, the results shows that the effect of EventPoint is better than DART; We use Vid2e tool provided by UZH to convert Oxford robotcar data into event-based format, and combined with INS information provided to carry out the global pose estimation experiment which is important in SLAM. As far as we know, this is the first work to carry out this challenging task.Sufficient experimental data show that EventPoint can get better results while achieve real time on CPU.

READ FULL TEXT

page 3

page 5

page 7

research
08/01/2021

Self-supervised Learning with Local Attention-Aware Feature

In this work, we propose a novel methodology for self-supervised learnin...
research
06/09/2021

Self-supervision of Feature Transformation for Further Improving Supervised Learning

Self-supervised learning, which benefits from automatically constructing...
research
08/17/2021

Investigating a Baseline Of Self Supervised Learning Towards Reducing Labeling Costs For Image Classification

Data labeling in supervised learning is considered an expensive and infe...
research
07/13/2022

Unsupervised Hebbian Learning on Point Sets in StarCraft II

Learning the evolution of real-time strategy (RTS) game is a challenging...
research
09/02/2021

Self-supervised Recommendation with Cross-channel Matching Representation and Hierarchical Contrastive Learning

Recently, using different channels to model social semantic information,...
research
05/20/2019

Self-Supervised Similarity Learning for Digital Pathology

Using features extracted from networks pretrained on ImageNet is a commo...
research
01/05/2023

Event Camera Data Pre-training

This paper proposes a pre-trained neural network for handling event came...

Please sign up or login with your details

Forgot password? Click here to reset