Evolved Neuromorphic Control for High Speed Divergence-based Landings of MAVs

03/06/2020
by   J. J. Hagenaars, et al.
0

Flying insects are capable of vision-based navigation in cluttered environments, reliably avoiding obstacles through fast and agile maneuvers, while being very efficient in the processing of visual stimuli. Meanwhile, autonomous micro air vehicles still lag far behind their biological counterparts, displaying inferior performance with a much higher energy consumption. In light of this, we want to mimic flying insects in terms of their processing capabilities, and consequently apply gained knowledge to a maneuver of relevance. This letter does so through evolving spiking neural networks for controlling landings of micro air vehicles using the divergence of the optical flow field of a downward-looking camera. We demonstrate that the resulting neuromorphic controllers transfer robustly from a highly abstracted simulation to the real world, performing fast and safe landings while keeping network spike rate minimal. Furthermore, we provide insight into the resources required for successfully solving the problem of divergence-based landing, showing that high-resolution control can potentially be learned with only a single spiking neuron. To the best of our knowledge, this is the first work integrating spiking neural networks in the control loop of a real-world flying robot. Videos of the experiments can be found at http://bit.ly/neuro-controller .

READ FULL TEXT

page 1

page 6

research
03/02/2020

Reinforcement co-Learning of Deep and Spiking Neural Networks for Energy-Efficient Mapless Navigation with Neuromorphic Hardware

Energy-efficient mapless navigation is crucial for mobile robots as they...
research
12/16/2019

Evolution of Robust High Speed Optical-Flow-Based Landing for Autonomous MAVs

Automatic optimization of robotic behavior has been the long-standing go...
research
07/14/2021

Resonant tunnelling diode nano-optoelectronic spiking nodes for neuromorphic information processing

In this work, we introduce an optoelectronic spiking artificial neuron c...
research
11/01/2020

Neuromorphic control for optic-flow-based landings of MAVs using the Loihi processor

Neuromorphic processors like Loihi offer a promising alternative to conv...
research
11/09/2020

All-optical neuromorphic binary convolution with a spiking VCSEL neuron for image gradient magnitudes

All-optical binary convolution with a photonic spiking vertical-cavity s...
research
07/21/2023

EV-Planner: Energy-Efficient Robot Navigation via Event-Based Physics-Guided Neuromorphic Planner

Vision-based object tracking is an essential precursor to performing aut...
research
10/01/2021

Evolved neuromorphic radar-based altitude controller for an autonomous open-source blimp

Robotic airships offer significant advantages in terms of safety, mobili...

Please sign up or login with your details

Forgot password? Click here to reset