Good Time to Ask: A Learning Framework for Asking for Help in Embodied Visual Navigation

06/20/2022
by   Jenny Zhang, et al.
0

In reality, it is often more efficient to ask for help than to search the entire space to find an object with an unknown location. We present a learning framework that enables an agent to actively ask for help in such embodied visual navigation tasks, where the feedback informs the agent of where the goal is in its view. To emulate the real-world scenario that a teacher may not always be present, we propose a training curriculum where feedback is not always available. We formulate an uncertainty measure of where the goal is and use empirical results to show that through this approach, the agent learns to ask for help effectively while remaining robust when feedback is not available.

READ FULL TEXT

page 2

page 3

page 5

research
03/06/2023

Robustness of Utilizing Feedback in Embodied Visual Navigation

This paper presents a framework for training an agent to actively reques...
research
12/02/2019

Just Ask:An Interactive Learning Framework for Vision and Language Navigation

In the vision and language navigation task, the agent may encounter ambi...
research
10/14/2022

AVLEN: Audio-Visual-Language Embodied Navigation in 3D Environments

Recent years have seen embodied visual navigation advance in two distinc...
research
06/06/2023

Active Sparse Conversations for Improved Audio-Visual Embodied Navigation

Efficient navigation towards an audio-goal necessitates an embodied agen...
research
11/18/2022

Ask4Help: Learning to Leverage an Expert for Embodied Tasks

Embodied AI agents continue to become more capable every year with the a...
research
02/05/2018

Adviser Networks: Learning What Question to Ask for Human-In-The-Loop Viewpoint Estimation

Humans have an unparalleled visual intelligence and can overcome visual ...
research
04/20/2020

Adaptation of a Lexical Organization for Social Engineering Detection and Response Generation

We present a paradigm for extensible lexicon development based on Lexica...

Please sign up or login with your details

Forgot password? Click here to reset