Hand Gesture Controlled Drones: An Open Source Library

03/27/2018
by   Kathiravan Natarajan, et al.
0

Drones are conventionally controlled using joysticks, remote controllers, mobile applications, and embedded computers. A few significant issues with these approaches are that drone control is limited by the range of electromagnetic radiation and susceptible to interference noise. In this study we propose the use of hand gestures as a method to control drones. We investigate the use of computer vision methods to develop an intuitive way of agent-less communication between a drone and its operator. Computer vision-based methods rely on the ability of a drone's camera to capture surrounding images and use pattern recognition to translate images to meaningful and/or actionable information. The proposed framework involves a few key parts toward an ultimate action to be taken. They are: image segregation from the video streams of front camera, creating a robust and reliable image recognition based on segregated images, and finally conversion of classified gestures into actionable drone movement, such as takeoff, landing, hovering and so forth. A set of five gestures are studied in this work. Haar feature-based AdaBoost classifier is employed for gesture recognition. We also envisage safety of the operator and drone's action calculating the distance based on computer vision for this task. A series of experiments are conducted to measure gesture recognition accuracies considering the major scene variabilities, illumination, background, and distance. Classification accuracies show that well-lit, clear background, and within 3 ft gestures are recognized correctly over 90 gesture recognition are discussed, too. The software library we developed, and hand gesture data sets are open-sourced at project website.

READ FULL TEXT

page 5

page 7

research
02/07/2021

DroneTrap: Drone Catching in Midair by Soft Robotic Hand with Color-Based Force Detection and Hand Gesture Recognition

The paper proposes a novel concept of docking drones to make this proces...
research
01/29/2023

Gesture Control of Micro-drone: A Lightweight-Net with Domain Randomization and Trajectory Generators

Micro-drones can be integrated into various industrial applications but ...
research
07/19/2015

Hand Gesture Recognition Library

In this paper we have presented a hand gesture recognition library. Vari...
research
03/05/2020

Implementation of a Natural User Interface to Command a Drone

In this work, we propose the use of a Natural User Interface (NUI) throu...
research
04/29/2021

Hand Gesture Recognition Based on a Nonconvex Regularization

Recognition of hand gestures is one of the most fundamental tasks in hum...
research
07/30/2020

DroneLight: Drone Draws in the Air using Long Exposure Light Painting and ML

We propose a novel human-drone interaction paradigm where a user directl...

Please sign up or login with your details

Forgot password? Click here to reset