Learning Robust Agents for Visual Navigation in Dynamic Environments: The Winning Entry of iGibson Challenge 2021

09/22/2021
by   Naoki Yokoyama, et al.
10

This paper presents an approach for improving navigation in dynamic and interactive environments, which won the 1st place in the iGibson Interactive Navigation Challenge 2021. While the last few years have produced impressive progress on PointGoal Navigation in static environments, relatively little effort has been made on more realistic dynamic environments. The iGibson Challenge proposed two new navigation tasks, Interactive Navigation and Social Navigation, which add displaceable obstacles and moving pedestrians into the simulator environment. Our approach to study these problems uses two key ideas. First, we employ large-scale reinforcement learning by leveraging the Habitat simulator, which supports high performance parallel computing for both simulation and synchronized learning. Second, we employ a new data augmentation technique that adds more dynamic objects into the environment, which can also be combined with traditional image-based augmentation techniques to boost the performance further. Lastly, we achieve sim-to-sim transfer from Habitat to the iGibson simulator, and demonstrate that our proposed methods allow us to train robust agents in dynamic environments with interactive objects or moving humans. Video link: https://www.youtube.com/watch?v=HxUX2HeOSE4

READ FULL TEXT

page 1

page 3

page 4

page 6

research
12/11/2017

MINOS: Multimodal Indoor Simulator for Navigation in Complex Environments

We present MINOS, a simulator designed to support the development of mul...
research
09/09/2020

SEAN: Social Environment for Autonomous Navigation

Social navigation research is performed on a variety of robotic platform...
research
01/23/2018

CHALET: Cornell House Agent Learning Environment

We present CHALET, a 3D house simulator with support for navigation and ...
research
04/28/2021

Pushing it out of the Way: Interactive Visual Navigation

We have observed significant progress in visual navigation for embodied ...
research
10/24/2019

HRL4IN: Hierarchical Reinforcement Learning for Interactive Navigation with Mobile Manipulators

Most common navigation tasks in human environments require auxiliary arm...
research
09/07/2017

Monocular Navigation in Large Scale Dynamic Environments

We present a processing technique for a robust reconstruction of motion ...
research
10/30/2019

Interactive Gibson: A Benchmark for Interactive Navigation in Cluttered Environments

We present Interactive Gibson, the first comprehensive benchmark for tra...

Please sign up or login with your details

Forgot password? Click here to reset