Translating Natural Language Instructions for Behavioral Robot Navigation with a Multi-Head Attention Mechanism

06/01/2020
by   Patricio Cerda-Mardini, et al.
0

We propose a multi-head attention mechanism as a blending layer in a neural network model that translates natural language to a high level behavioral language for indoor robot navigation. We follow the framework established by (Zang et al., 2018a) that proposes the use of a navigation graph as a knowledge base for the task. Our results show significant performance gains when translating instructions on previously unseen environments, therefore, improving the generalization capabilities of the model.

READ FULL TEXT

page 1

page 2

page 3

research
09/24/2018

Translating Navigation Instructions in Natural Language to a High-Level Plan for Behavioral Robot Navigation

We propose an end-to-end deep learning model for translating free-form n...
research
01/08/2020

High-Level Plan for Behavioral Robot Navigation with Natural Language Directions and R-NET

When the navigational environment is known, it can be represented as a g...
research
05/16/2018

FollowNet: Robot Navigation by Following Natural Language Directions with Deep Reinforcement Learning

Understanding and following directions provided by humans can enable rob...
research
06/15/2023

Tell Me Where to Go: A Composable Framework for Context-Aware Embodied Robot Navigation

Humans have the remarkable ability to navigate through unfamiliar enviro...
research
11/10/2020

Grounding Implicit Goal Description for Robot Indoor Navigation Via Recursive Belief Update

Natural language-based robotic navigation remains a challenging problem ...
research
11/21/2019

Teaching Perception

The visual world is very rich and generally too complex to perceive in i...
research
10/28/2020

The Amazing Race TM: Robot Edition

State-of-the-art natural-language-driven autonomous-navigation systems g...

Please sign up or login with your details

Forgot password? Click here to reset