VGPN: Voice-Guided Pointing Robot Navigation for Humans

04/03/2020
by   Jun Hu, et al.
0

Pointing gestures are widely used in robot navigationapproaches nowadays. However, most approaches only use point-ing gestures, and these have two major limitations. Firstly, they need to recognize pointing gestures all the time, which leads to long processing time and significant system overheads. Secondly,the user's pointing direction may not be very accurate, so the robot may go to an undesired place. To relieve these limitations,we propose a voice-guided pointing robot navigation approach named VGPN, and implement its prototype on a wheeled robot,TurtleBot 2. VGPN recognizes a pointing gesture only if voice information is insufficient for navigation. VGPN also uses voice information as a supplementary channel to help determine the target position of the user's pointing gesture. In the evaluation,we compare VGPN to the pointing-only navigation approach. The results show that VGPN effectively reduces the processing timecost when pointing gesture is unnecessary, and improves the usersatisfaction with navigation accuracy.

READ FULL TEXT

page 3

page 4

research
03/18/2023

Enabling Voice-Accompanying Hand-to-Face Gesture Recognition with Cross-Device Sensing

Gestures performed accompanying the voice are essential for voice intera...
research
07/13/2020

Situated Multimodal Control of a Mobile Robot: Navigation through a Virtual Environment

We present a new interface for controlling a navigation robot in novel e...
research
07/20/2016

HoloMed: A Low-Cost Gesture-Based Holographic

During medicine studies, visualization of certain elements is common and...
research
08/02/2023

Point Anywhere: Directed Object Estimation from Omnidirectional Images

One of the intuitive instruction methods in robot navigation is a pointi...
research
08/05/2021

Communicative Learning with Natural Gestures for Embodied Navigation Agents with Human-in-the-Scene

Human-robot collaboration is an essential research topic in artificial i...
research
10/22/2020

Quantitative analysis of robot gesticulation behavior

Social robot capabilities, such as talking gestures, are best produced u...
research
09/19/2022

Gesture2Path: Imitation Learning for Gesture-aware Navigation

As robots increasingly enter human-centered environments, they must not ...

Please sign up or login with your details

Forgot password? Click here to reset