Translating Navigation Instructions in Natural Language to a High-Level Plan for Behavioral Robot Navigation

09/24/2018
by   Xiaoxue Zang, et al.
0

We propose an end-to-end deep learning model for translating free-form natural language instructions to a high-level plan for behavioral robot navigation. We use attention models to connect information from both the user instructions and a topological representation of the environment. We evaluate our model's performance on a new dataset containing 10,050 pairs of navigation instructions. Our model significantly outperforms baseline approaches. Furthermore, our results suggest that it is possible to leverage the environment map as a relevant knowledge base to facilitate the translation of free-form navigational instruction.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/01/2020

Translating Natural Language Instructions for Behavioral Robot Navigation with a Multi-Head Attention Mechanism

We propose a multi-head attention mechanism as a blending layer in a neu...
research
01/08/2020

High-Level Plan for Behavioral Robot Navigation with Natural Language Directions and R-NET

When the navigational environment is known, it can be represented as a g...
research
12/09/2020

Topological Planning with Transformers for Vision-and-Language Navigation

Conventional approaches to vision-and-language navigation (VLN) are trai...
research
09/19/2019

RUN through the Streets: A New Dataset and Baseline Models for Realistic Urban Navigation

Following navigation instructions in natural language requires a composi...
research
11/10/2020

Grounding Implicit Goal Description for Robot Indoor Navigation Via Recursive Belief Update

Natural language-based robotic navigation remains a challenging problem ...
research
06/15/2023

Tell Me Where to Go: A Composable Framework for Context-Aware Embodied Robot Navigation

Humans have the remarkable ability to navigate through unfamiliar enviro...
research
07/21/2023

CARTIER: Cartographic lAnguage Reasoning Targeted at Instruction Execution for Robots

This work explores the capacity of large language models (LLMs) to addre...

Please sign up or login with your details

Forgot password? Click here to reset