Unmanned Aerial Vehicle Control Through Domain-based Automatic Speech Recognition

09/09/2020
by   Ruben Contreras, et al.
4

Currently, unmanned aerial vehicles, such as drones, are becoming a part of our lives and reaching out to many areas of society, including the industrialized world. A common alternative to control the movements and actions of the drone is through unwired tactile interfaces, for which different remote control devices can be found. However, control through such devices is not a natural, human-like communication interface, which sometimes is difficult to master for some users. In this work, we present a domain-based speech recognition architecture to effectively control an unmanned aerial vehicle such as a drone. The drone control is performed using a more natural, human-like way to communicate the instructions. Moreover, we implement an algorithm for command interpretation using both Spanish and English languages, as well as to control the movements of the drone in a simulated domestic environment. The conducted experiments involve participants giving voice commands to the drone in both languages in order to compare the effectiveness of each of them, considering the mother tongue of the participants in the experiment. Additionally, different levels of distortion have been applied to the voice commands in order to test the proposed approach when facing noisy input signals. The obtained results show that the unmanned aerial vehicle is capable of interpreting user voice instructions achieving an improvement in speech-to-action recognition for both languages when using phoneme matching in comparison to only using the cloud-based algorithm without domain-based instructions. Using raw audio inputs, the cloud-based approach achieves 74.81 and 97.04 using our phoneme matching approach the results are improved achieving 93.33 and 100.00

READ FULL TEXT

page 2

page 9

page 14

research
07/31/2018

Unmanned Aerial Vehicle Path Planning for Traffic Estimation and Detection of Non-Recurrent Congestion

Unmanned aerial vehicles (drones) can be used in traffic and road monito...
research
12/04/2015

On the Min-cost Traveling Salesman Problem with Drone

Once known to be used exclusively in military domain, unmanned aerial ve...
research
07/02/2019

Kite: Automatic speech recognition for unmanned aerial vehicles

This paper addresses the problem of building a speech recognition system...
research
07/16/2022

Evaluating a Signalized Intersection Performance Using Unmanned Aerial Data

This paper presents a novel method to compute various measures of effect...
research
11/26/2020

Learning to Assist Drone Landings

Unmanned aerial vehicles (UAVs) are often used for navigating dangerous ...
research
08/08/2023

Estimation of Human Condition at Disaster Site Using Aerial Drone Images

Drones are being used to assess the situation in various disasters. In t...
research
09/12/2023

Behind The Wings: The Case of Reverse Engineering and Drone Hijacking in DJI Enhanced Wi-Fi Protocol

This research paper entails an examination of the Enhanced Wi-Fi protoco...

Please sign up or login with your details

Forgot password? Click here to reset