Deep Neural Network Architecture Search for Accurate Visual Pose Estimation aboard Nano-UAVs

03/03/2023
by   Elia Cereda, et al.
0

Miniaturized autonomous unmanned aerial vehicles (UAVs) are an emerging and trending topic. With their form factor as big as the palm of one hand, they can reach spots otherwise inaccessible to bigger robots and safely operate in human surroundings. The simple electronics aboard such robots (sub-100mW) make them particularly cheap and attractive but pose significant challenges in enabling onboard sophisticated intelligence. In this work, we leverage a novel neural architecture search (NAS) technique to automatically identify several Pareto-optimal convolutional neural networks (CNNs) for a visual pose estimation task. Our work demonstrates how real-life and field-tested robotics applications can concretely leverage NAS technologies to automatically and efficiently optimize CNNs for the specific hardware constraints of small UAVs. We deploy several NAS-optimized CNNs and run them in closed-loop aboard a 27-g Crazyflie nano-UAV equipped with a parallel ultra-low power System-on-Chip. Our results improve the State-of-the-Art by reducing the in-field control error of 32  50Hz@90mW.

READ FULL TEXT
research
03/19/2021

Fully Onboard AI-powered Human-Drone Pose Estimation on Ultra-low Power Autonomous Flying Nano-UAVs

Artificial intelligence-powered pocket-sized air robots have the potenti...
research
05/10/2019

An Open Source and Open Hardware Deep Learning-powered Visual Navigation Engine for Autonomous Nano-UAVs

Nano-size unmanned aerial vehicles (UAVs), with few centimeters of diame...
research
05/04/2018

Ultra Low Power Deep-Learning-powered Autonomous Nano Drones

Flying in dynamic, urban, highly-populated environments represents an op...
research
06/26/2020

AutoSNAP: Automatically Learning Neural Architectures for Instrument Pose Estimation

Despite recent successes, the advances in Deep Learning have not yet bee...
research
12/15/2022

Colab NAS: Obtaining lightweight task-specific convolutional neural networks following Occam's razor

The current trend of applying transfer learning from CNNs trained on lar...
research
08/18/2022

Kraken: A Direct Event/Frame-Based Multi-sensor Fusion SoC for Ultra-Efficient Visual Processing in Nano-UAVs

Small-size unmanned aerial vehicles (UAV) have the potential to dramatic...
research
08/03/2023

Sim-to-Real Vision-depth Fusion CNNs for Robust Pose Estimation Aboard Autonomous Nano-quadcopter

Nano-quadcopters are versatile platforms attracting the interest of both...

Please sign up or login with your details

Forgot password? Click here to reset