FEDORA: Flying Event Dataset fOr Reactive behAvior

05/22/2023
by   Amogh Joshi, et al.
0

The ability of living organisms to perform complex high speed manoeuvers in flight with a very small number of neurons and an incredibly low failure rate highlights the efficacy of these resource-constrained biological systems. Event-driven hardware has emerged, in recent years, as a promising avenue for implementing complex vision tasks in resource-constrained environments. Vision-based autonomous navigation and obstacle avoidance consists of several independent but related tasks such as optical flow estimation, depth estimation, Simultaneous Localization and Mapping (SLAM), object detection, and recognition. To ensure coherence between these tasks, it is imperative that they be trained on a single dataset. However, most existing datasets provide only a selected subset of the required data. This makes inter-network coherence difficult to achieve. Another limitation of existing datasets is the limited temporal resolution they provide. To address these limitations, we present FEDORA, a first-of-its-kind fully synthetic dataset for vision-based tasks, with ground truths for depth, pose, ego-motion, and optical flow. FEDORA is the first dataset to provide optical flow at three different frequencies - 10Hz, 25Hz, and 50Hz

READ FULL TEXT

page 4

page 5

page 6

research
09/30/2021

Uncertainty Estimation of Dense Optical-Flow for Robust Visual Navigation

This paper presents a novel dense optical-flow algorithm to solve the mo...
research
09/14/2022

NanoFlowNet: Real-time Dense Optical Flow on a Nano Quadcopter

Nano quadcopters are small, agile, and cheap platforms that are well sui...
research
03/14/2023

BlinkFlow: A Dataset to Push the Limits of Event-based Optical Flow Estimation

Event cameras provide high temporal precision, low data rates, and high ...
research
11/22/2022

Vision-based localization methods under GPS-denied conditions

This paper reviews vision-based localization methods in GPS-denied envir...
research
01/07/2020

Aggressive Perception-Aware Navigation using Deep Optical Flow Dynamics and PixelMPC

Recently, vision-based control has gained traction by leveraging the pow...
research
09/13/2023

GelFlow: Self-supervised Learning of Optical Flow for Vision-Based Tactile Sensor Displacement Measurement

High-resolution multi-modality information acquired by vision-based tact...
research
07/12/2023

Unsupervised Optical Flow Estimation with Dynamic Timing Representation for Spike Camera

Efficiently selecting an appropriate spike stream data length to extract...

Please sign up or login with your details

Forgot password? Click here to reset