Event-based Object Detection and Tracking for Space Situational Awareness

11/20/2019
by   Saeed Afshar, et al.
15

In this work, we present optical space imaging using an unconventional yet promising class of imaging devices known as neuromorphic event-based sensors. These devices, which are modeled on the human retina, do not operate with frames, but rather generate asynchronous streams of events in response to changes in log-illumination at each pixel. These devices are therefore extremely fast, do not have fixed exposure times, allow for imaging whilst the device is moving and enable low power space imaging during daytime as well as night without modification of the sensors. Recorded at multiple remote sites, we present the first event-based space imaging dataset including recordings from multiple event-based sensors from multiple providers, greatly lowering the barrier to entry for other researchers given the scarcity of such sensors and the expertise required to operate them. The dataset contains 236 separate recordings and 572 labeled resident space objects. The event-based imaging paradigm presents unique opportunities and challenges motivating the development of specialized event-based algorithms that can perform tasks such as detection and tracking in an event-based manner. Here we examine a range of such event-based algorithms for detection and tracking. The presented methods are designed specifically for space situational awareness applications and are evaluated in terms of accuracy and speed and suitability for implementation in neuromorphic hardware on remote or space-based imaging platforms.

READ FULL TEXT

page 3

page 5

page 14

page 20

page 35

page 37

research
05/21/2018

Event-based Convolutional Networks for Object Detection in Neuromorphic Cameras

Event-based cameras are bioinspired sensors able to perceive changes in ...
research
07/21/2020

A Hybrid Neuromorphic Object Tracking and Classification Framework for Real-time Systems

Deep learning inference that needs to largely take place on the 'edge' i...
research
10/04/2019

EBBIOT: A Low-complexity Tracking Algorithm for Surveillance in IoVT Using Stationary Neuromorphic Vision Sensors

In this paper, we present EBBIOT-a novel paradigm for object tracking us...
research
08/15/2023

Neuromorphic Seatbelt State Detection for In-Cabin Monitoring with Event Cameras

Neuromorphic vision sensors, or event cameras, differ from conventional ...
research
07/08/2018

Real-time clustering and multi-target tracking using event-based sensors

Clustering is crucial for many computer vision applications such as robu...
research
01/16/2020

Contextual Sense Making by Fusing Scene Classification, Detections, and Events in Full Motion Video

With the proliferation of imaging sensors, the volume of multi-modal ima...
research
09/04/2023

High Frequency, High Accuracy Pointing onboard Nanosats using Neuromorphic Event Sensing and Piezoelectric Actuation

As satellites become smaller, the ability to maintain stable pointing de...

Please sign up or login with your details

Forgot password? Click here to reset