On Embodied Visual Navigation in Real Environments Through Habitat

10/26/2020
by   Marco Rosano, et al.
18

Visual navigation models based on deep learning can learn effective policies when trained on large amounts of visual observations through reinforcement learning. Unfortunately, collecting the required experience in the real world requires the deployment of a robotic platform, which is expensive and time-consuming. To deal with this limitation, several simulation platforms have been proposed in order to train visual navigation policies on virtual environments efficiently. Despite the advantages they offer, simulators present a limited realism in terms of appearance and physical dynamics, leading to navigation policies that do not generalize in the real world. In this paper, we propose a tool based on the Habitat simulator which exploits real world images of the environment, together with sensor and actuator noise models, to produce more realistic navigation episodes. We perform a range of experiments to assess the ability of such policies to generalize using virtual and real-world images, as well as observations transformed with unsupervised domain adaptation approaches. We also assess the impact of sensor and actuation noise on the navigation performance and investigate whether it allows to learn more robust navigation policies. We show that our tool can effectively help to train and evaluate navigation policies on real-world observations without running navigation pisodes in the real world.

READ FULL TEXT
research
02/02/2022

Image-based Navigation in Real-World Environments via Multiple Mid-level Representations: Fusion Models, Benchmark and Efficient Evaluation

Navigating complex indoor environments requires a deep understanding of ...
research
10/27/2020

Unsupervised Domain Adaptation for Visual Navigation

Advances in visual navigation methods have led to intelligent embodied n...
research
03/14/2023

RE-MOVE: An Adaptive Policy Design Approach for Dynamic Environments via Language-Based Feedback

Reinforcement learning-based policies for continuous control robotic nav...
research
03/05/2023

Vision based Virtual Guidance for Navigation

This paper explores the impact of virtual guidance on mid-level represen...
research
11/27/2018

Learning with Stochastic Guidance for Navigation

Due to the sparse rewards and high degree of environment variation, rein...
research
10/14/2021

Augmenting Imitation Experience via Equivariant Representations

The robustness of visual navigation policies trained through imitation o...
research
12/13/2022

Learning Robotic Navigation from Experience: Principles, Methods, and Recent Results

Navigation is one of the most heavily studied problems in robotics, and ...

Please sign up or login with your details

Forgot password? Click here to reset