XAI-N: Sensor-based Robot Navigation using Expert Policies and Decision Trees

04/22/2021
by   Aaron M. Roth, et al.
2

We present a novel sensor-based learning navigation algorithm to compute a collision-free trajectory for a robot in dense and dynamic environments with moving obstacles or targets. Our approach uses deep reinforcement learning-based expert policy that is trained using a sim2real paradigm. In order to increase the reliability and handle the failure cases of the expert policy, we combine with a policy extraction technique to transform the resulting policy into a decision tree format. The resulting decision tree has properties which we use to analyze and modify the policy and improve performance on navigation metrics including smoothness, frequency of oscillation, frequency of immobilization, and obstruction of target. We are able to modify the policy to address these imperfections without retraining, combining the learning power of deep learning with the control of domain-specific algorithms. We highlight the benefits of our algorithm in simulated environments and navigating a Clearpath Jackal robot among moving pedestrians.

READ FULL TEXT
research
09/19/2022

MSVIPER: Improved Policy Distillation for Reinforcement-Learning-Based Robot Navigation

We present Multiple Scenario Verifiable Reinforcement Learning via Polic...
research
04/07/2020

CrowdSteer: Realtime Smooth and Collision-Free Robot Navigation in Dense Crowd Scenarios Trained using High-Fidelity Simulation

We present a novel high fidelity 3-D simulator that significantly reduce...
research
05/22/2018

Verifiable Reinforcement Learning via Policy Extraction

While deep reinforcement learning has successfully solved many challengi...
research
10/04/2019

DeepMNavigate: Deep Reinforced Multi-Robot Navigation Unifying Local Global Collision Avoidance

We present a novel algorithm (DeepMNavigate) for global multi-agent navi...
research
01/16/2023

DRL-VO: Learning to Navigate Through Crowded Dynamic Scenes Using Velocity Obstacles

This paper proposes a novel learning-based control policy with strong ge...
research
08/17/2022

Deep Reinforcement Learning based Robot Navigation in Dynamic Environments using Occupancy Values of Motion Primitives

This paper presents a Deep Reinforcement Learning based navigation appro...
research
04/03/2023

Data-Efficient Policy Selection for Navigation in Partial Maps via Subgoal-Based Abstraction

We present a novel approach for fast and reliable policy selection for n...

Please sign up or login with your details

Forgot password? Click here to reset