Predicting Topological Maps for Visual Navigation in Unexplored Environments

11/23/2022
by   Huangying Zhan, et al.
0

We propose a robotic learning system for autonomous exploration and navigation in unexplored environments. We are motivated by the idea that even an unseen environment may be familiar from previous experiences in similar environments. The core of our method, therefore, is a process for building, predicting, and using probabilistic layout graphs for assisting goal-based visual navigation. We describe a navigation system that uses the layout predictions to satisfy high-level goals (e.g. "go to the kitchen") more rapidly and accurately than the prior art. Our proposed navigation framework comprises three stages: (1) Perception and Mapping: building a multi-level 3D scene graph; (2) Prediction: predicting probabilistic 3D scene graph for the unexplored environment; (3) Navigation: assisting navigation with the graphs. We test our framework in Matterport3D and show more success and efficient navigation in unseen environments.

READ FULL TEXT

page 3

page 8

page 10

page 11

page 12

page 13

page 14

page 15

research
09/10/2019

Bayesian Relational Memory for Semantic Visual Navigation

We introduce a new memory architecture, Bayesian Relational Memory (BRM)...
research
11/16/2018

On the Complexity of Exploration in Goal-Driven Navigation

Building agents that can explore their environments intelligently is a c...
research
12/02/2022

Private Multiparty Perception for Navigation

We introduce a framework for navigating through cluttered environments b...
research
03/01/2019

A Behavioral Approach to Visual Navigation with Graph Localization Networks

Inspired by research in psychology, we introduce a behavioral approach f...
research
12/05/2022

PEANUT: Predicting and Navigating to Unseen Targets

Efficient ObjectGoal navigation (ObjectNav) in novel environments requir...
research
07/17/2023

Robotic Exploration for Mapping

Robotic Exploration has evolved rapidly in the past two decades as new a...
research
11/30/2022

Layout-aware Dreamer for Embodied Referring Expression Grounding

In this work, we study the problem of Embodied Referring Expression Grou...

Please sign up or login with your details

Forgot password? Click here to reset