Vision based Virtual Guidance for Navigation

03/05/2023
by   Hsuan-Kung Yang, et al.
0

This paper explores the impact of virtual guidance on mid-level representation-based navigation, where an agent performs navigation tasks based solely on visual observations. Instead of providing distance measures or numerical directions to guide the agent, which may be difficult for it to interpret visually, the paper investigates the potential of different forms of virtual guidance schemes on navigation performance. Three schemes of virtual guidance signals are explored: virtual navigation path, virtual waypoints, and a combination of both. The experiments were conducted using a virtual city built with the Unity engine to train the agents while avoiding obstacles. The results show that virtual guidance provides the agent with more meaningful navigation information and achieves better performance in terms of path completion rates and navigation efficiency. In addition, a set of analyses were provided to investigate the failure cases and the navigated trajectories, and a pilot study was conducted for the real-world scenarios.

READ FULL TEXT

page 4

page 7

research
08/07/2023

Quantifying the Impact of XR Visual Guidance on User Performance Using a Large-Scale Virtual Assembly Experiment

The combination of Visual Guidance and Extended Reality (XR) technology ...
research
10/17/2022

Multimodal Shared Autonomy for Social Navigation Assistance of Telepresence Robots

Mobile telepresence robots (MTRs) have become increasingly popular in th...
research
10/26/2020

On Embodied Visual Navigation in Real Environments Through Habitat

Visual navigation models based on deep learning can learn effective poli...
research
07/26/2019

To Learn or Not to Learn: Analyzing the Role of Learning for Navigation in Virtual Environments

In this paper we compare learning-based methods and classical methods fo...
research
12/11/2019

Learning to Request Guidance in Emergent Communication

Previous research into agent communication has shown that a pre-trained ...
research
11/27/2018

Learning with Stochastic Guidance for Navigation

Due to the sparse rewards and high degree of environment variation, rein...
research
06/07/2023

ColNav: Real-Time Colon Navigation for Colonoscopy

Colorectal cancer screening through colonoscopy continues to be the domi...

Please sign up or login with your details

Forgot password? Click here to reset