Gesture Control of Micro-drone: A Lightweight-Net with Domain Randomization and Trajectory Generators

01/29/2023
by   Isaac Osei Agyemang, et al.
0

Micro-drones can be integrated into various industrial applications but are constrained by their computing power and expert pilots, a secondary challenge. This study presents a computationally-efficient deep convolutional neural network that utilizes Gabor filters and spatial separable convolutions with low computational complexities. An attention module is integrated with the model to complement the performance. Further, perception-based action space and trajectory generators are integrated with the model's predictions for intuitive navigation. The computationally-efficient model aids a human operator in controlling a micro-drone via gestures. Nearly 18 are conserved using the NVIDIA GPU profiler during training. Using a low-cost DJI Tello drone for experiment verification, the computationally-efficient model shows promising results compared to a state-of-the-art and conventional computer vision-based technique.

READ FULL TEXT

page 3

page 6

research
03/27/2018

Hand Gesture Controlled Drones: An Open Source Library

Drones are conventionally controlled using joysticks, remote controllers...
research
05/24/2019

Visual Model-predictive Localization for Computationally Efficient Autonomous Racing of a 72-gram Drone

Drone racing is becoming a popular e-sport all over the world, and beati...
research
04/20/2021

A simple vision-based navigation and control strategy for autonomous drone racing

In this paper, we present a control system that allows a drone to fly au...
research
07/03/2019

Slim-CNN: A Light-Weight CNN for Face Attribute Prediction

We introduce a computationally-efficient CNN micro-architecture Slim Mod...
research
05/27/2021

Robust Navigation for Racing Drones based on Imitation Learning and Modularization

This paper presents a vision-based modularized drone racing navigation s...
research
07/22/2018

NAVREN-RL: Learning to fly in real environment via end-to-end deep reinforcement learning using monocular images

We present NAVREN-RL, an approach to NAVigate an unmanned aerial vehicle...
research
03/17/2020

Co-Optimizing Performance and Memory FootprintVia Integrated CPU/GPU Memory Management, anImplementation on Autonomous Driving Platform

Cutting-edge embedded system applications, such as self-driving cars and...

Please sign up or login with your details

Forgot password? Click here to reset