Deep Learning on Home Drone: Searching for the Optimal Architecture

09/21/2022
by   Alaa Maalouf, et al.
60

We suggest the first system that runs real-time semantic segmentation via deep learning on a weak micro-computer such as the Raspberry Pi Zero v2 (whose price was $15) attached to a toy-drone. In particular, since the Raspberry Pi weighs less than 16 grams, and its size is half of a credit card, we could easily attach it to the common commercial DJI Tello toy-drone (<$100, <90 grams, 98 × 92.5 × 41 mm). The result is an autonomous drone (no laptop nor human in the loop) that can detect and classify objects in real-time from a video stream of an on-board monocular RGB camera (no GPS or LIDAR sensors). The companion videos demonstrate how this Tello drone scans the lab for people (e.g. for the use of firefighters or security forces) and for an empty parking slot outside the lab. Existing deep learning solutions are either much too slow for real-time computation on such IoT devices, or provide results of impractical quality. Our main challenge was to design a system that takes the best of all worlds among numerous combinations of networks, deep learning platforms/frameworks, compression techniques, and compression ratios. To this end, we provide an efficient searching algorithm that aims to find the optimal combination which results in the best tradeoff between the network running time and its accuracy/performance.

READ FULL TEXT

page 1

page 2

page 3

page 5

page 6

research
03/05/2022

Newton-PnP: Real-time Visual Navigation for Autonomous Toy-Drones

The Perspective-n-Point problem aims to estimate the relative pose betwe...
research
02/01/2023

Autonomous Drone Landing: Marked Landing Pads and Solidified Lava Flows

Landing is the most challenging and risky aspect of multirotor drone fli...
research
01/02/2022

VISAS – Detecting GPS spoofing attacks against drones by analyzing camera's video stream

In this study, we propose an innovative method for the real-time detecti...
research
07/14/2020

Long-Term Planning with Deep Reinforcement Learning on Autonomous Drones

In this paper, we study a long-term planning scenario that is based on d...
research
01/09/2018

Game of Drones - Detecting Streamed POI from Encrypted FPV Channel

Drones have created a new threat to people's privacy. We are now in an e...
research
04/17/2021

ARES: Accurate, Autonomous, Near Real-time 3D Reconstruction using Drones

Drones will revolutionize 3D modeling. A 3D model represents an accurate...
research
11/10/2021

Towards Live Video Analytics with On-Drone Deeper-yet-Compatible Compression

In this work, we present DCC(Deeper-yet-Compatible Compression), one ena...

Please sign up or login with your details

Forgot password? Click here to reset