Real-time clustering and multi-target tracking using event-based sensors

07/08/2018
by   Francisco Barranco, et al.
0

Clustering is crucial for many computer vision applications such as robust tracking, object detection and segmentation. This work presents a real-time clustering technique that takes advantage of the unique properties of event-based vision sensors. Since event-based sensors trigger events only when the intensity changes, the data is sparse, with low redundancy. Thus, our approach redefines the well-known mean-shift clustering method using asynchronous events instead of conventional frames. The potential of our approach is demonstrated in a multi-target tracking application using Kalman filters to smooth the trajectories. We evaluated our method on an existing dataset with patterns of different shapes and speeds, and a new dataset that we collected. The sensor was attached to the Baxter robot in an eye-in-hand setup monitoring real-world objects in an action manipulation task. Clustering accuracy achieved an F-measure of 0.95, reducing the computational cost by 88 compared to the frame-based method. The average error for tracking was 2.5 pixels and the clustering achieved a consistent number of clusters along time.

READ FULL TEXT

page 1

page 6

research
10/18/2015

Real-time Tracking Based on Neuromrophic Vision

Real-time tracking is an important problem in computer vision in which m...
research
01/22/2019

Unsupervised Automated Event Detection using an Iterative Clustering based Segmentation Approach

A class of vision problems, less commonly studied, consists of detecting...
research
07/19/2022

eCDT: Event Clustering for Simultaneous Feature Detection and Tracking-

Contrary to other standard cameras, event cameras interpret the world in...
research
02/09/2022

Real-Time Event-Based Tracking and Detection for Maritime Environments

Event cameras are ideal for object tracking applications due to their ab...
research
10/04/2019

EBBIOT: A Low-complexity Tracking Algorithm for Surveillance in IoVT Using Stationary Neuromorphic Vision Sensors

In this paper, we present EBBIOT-a novel paradigm for object tracking us...
research
11/20/2019

Event-based Object Detection and Tracking for Space Situational Awareness

In this work, we present optical space imaging using an unconventional y...
research
05/31/2020

EBBINNOT: A Hardware Efficient Hybrid Event-Frame Tracker for Stationary Neuromorphic Vision Sensors

In this paper, we present a hybrid event-frame approach for detecting an...

Please sign up or login with your details

Forgot password? Click here to reset