Adaptive and Explainable Deployment of Navigation Skills via Hierarchical Deep Reinforcement Learning

05/31/2023
by   Kyowoon Lee, et al.
0

For robotic vehicles to navigate robustly and safely in unseen environments, it is crucial to decide the most suitable navigation policy. However, most existing deep reinforcement learning based navigation policies are trained with a hand-engineered curriculum and reward function which are difficult to be deployed in a wide range of real-world scenarios. In this paper, we propose a framework to learn a family of low-level navigation policies and a high-level policy for deploying them. The main idea is that, instead of learning a single navigation policy with a fixed reward function, we simultaneously learn a family of policies that exhibit different behaviors with a wide range of reward functions. We then train the high-level policy which adaptively deploys the most suitable navigation skill. We evaluate our approach in simulation and the real world and demonstrate that our method can learn diverse navigation skills and adaptively deploy them. We also illustrate that our proposed hierarchical learning framework presents explainability by providing semantics for the behavior of an autonomous agent.

READ FULL TEXT

page 1

page 3

page 4

page 5

page 6

research
04/27/2020

Emergent Real-World Robotic Skills via Unsupervised Off-Policy Reinforcement Learning

Reinforcement learning provides a general framework for learning robotic...
research
04/27/2023

SocNavGym: A Reinforcement Learning Gym for Social Navigation

It is essential for autonomous robots to be socially compliant while nav...
research
07/08/2021

Towards Autonomous Pipeline Inspection with Hierarchical Reinforcement Learning

Inspection and maintenance are two crucial aspects of industrial pipelin...
research
09/17/2021

Landmark Policy Optimization for Object Navigation Task

This work studies object goal navigation task, which involves navigating...
research
03/23/2019

Long Range Neural Navigation Policies for the Real World

Learned Neural Network based policies have shown promising results for r...
research
12/16/2022

Offline Reinforcement Learning for Visual Navigation

Reinforcement learning can enable robots to navigate to distant goals wh...
research
12/29/2022

Visual CPG-RL: Learning Central Pattern Generators for Visually-Guided Quadruped Navigation

In this paper, we present a framework for learning quadruped navigation ...

Please sign up or login with your details

Forgot password? Click here to reset