Gesture-based Piloting of an Aerial Robot using Monocular Vision

03/02/2018
by   Ting Sun, et al.
0

Aerial robots are becoming popular among general public, and with the development of artificial intelligence (AI), there is a trend to equip aerial robots with a natural user interface (NUI). Hand/arm gestures are an intuitive way to communicate for humans, and various research works have focused on controlling an aerial robot with natural gestures. However, the techniques in this area are still far from mature. Many issues in this area have been poorly addressed, such as the principles of choosing gestures from the design point of view, hardware requirements from an economic point of view, considerations of data availability, and algorithm complexity from a practical perspective. Our work focuses on building an economical monocular system particularly designed for gesture-based piloting of an aerial robot. Natural arm gestures are mapped to rich target directions and convenient fine adjustment is achieved. Practical piloting scenarios, hardware cost and algorithm applicability are jointly considered in our system design. The entire system is successfully implemented in an aerial robot and various properties of the system are tested.

READ FULL TEXT

page 4

page 7

page 8

research
10/30/2018

Robots Learn Social Skills: End-to-End Learning of Co-Speech Gesture Generation for Humanoid Robots

Co-speech gestures enhance interaction experiences between humans as wel...
research
05/21/2019

Design of conversational humanoid robot based on hardware independent gesture generation

With an increasing need for elderly and disability care, there is an inc...
research
10/18/2004

Neural Architectures for Robot Intelligence

We argue that the direct experimental approaches to elucidate the archit...
research
08/05/2021

Communicative Learning with Natural Gestures for Embodied Navigation Agents with Human-in-the-Scene

Human-robot collaboration is an essential research topic in artificial i...
research
09/17/2022

Hand and Arm Gesture-based Human-Robot Interaction: A Review

The study of Human-Robot Interaction (HRI) aims to create close and frie...
research
07/06/2023

MorphoArms: Morphogenetic Teleoperation of Multimanual Robot

Nowadays, there are few unmanned aerial vehicles (UAVs) capable of flyin...
research
10/13/2020

Labeling the Phrase Set of the Conversation Agent, Rinna

Mapping spoken text to gestures is an important research area for robots...

Please sign up or login with your details

Forgot password? Click here to reset