Learning Composable Behavior Embeddings for Long-horizon Visual Navigation

02/19/2021
by   Xiangyun Meng, et al.
0

Learning high-level navigation behaviors has important implications: it enables robots to build compact visual memory for repeating demonstrations and to build sparse topological maps for planning in novel environments. Existing approaches only learn discrete, short-horizon behaviors. These standalone behaviors usually assume a discrete action space with simple robot dynamics, thus they cannot capture the intricacy and complexity of real-world trajectories. To this end, we propose Composable Behavior Embedding (CBE), a continuous behavior representation for long-horizon visual navigation. CBE is learned in an end-to-end fashion; it effectively captures path geometry and is robust to unseen obstacles. We show that CBE can be used to performing memory-efficient path following and topological mapping, saving more than an order of magnitude of memory than behavior-less approaches.

READ FULL TEXT

page 1

page 2

page 3

page 4

page 5

page 6

page 7

page 8

research
09/26/2018

Learning Navigation Behaviors End to End

A longstanding goal of behavior-based robotics is to solve high-level na...
research
10/16/2021

Lifelong Topological Visual Navigation

The ability for a robot to navigate with only the use of vision is appea...
research
03/07/2023

One-4-All: Neural Potential Fields for Embodied Navigation

A fundamental task in robotics is to navigate between two locations. In ...
research
09/26/2019

Scaling Local Control to Large-Scale Topological Navigation

Visual topological navigation has been revitalized recently thanks to th...
research
12/09/2020

Topological Planning with Transformers for Vision-and-Language Navigation

Conventional approaches to vision-and-language navigation (VLN) are trai...
research
09/16/2021

End-to-End Partially Observable Visual Navigation in a Diverse Environment

How can a robot navigate successfully in a rich and diverse environment,...
research
12/03/2019

Dream to Control: Learning Behaviors by Latent Imagination

Learned world models summarize an agent's experience to facilitate learn...

Please sign up or login with your details

Forgot password? Click here to reset