Curriculum Learning for Safe Mapless Navigation

12/23/2021
by   Luca Marzari, et al.
0

This work investigates the effects of Curriculum Learning (CL)-based approaches on the agent's performance. In particular, we focus on the safety aspect of robotic mapless navigation, comparing over a standard end-to-end (E2E) training strategy. To this end, we present a CL approach that leverages Transfer of Learning (ToL) and fine-tuning in a Unity-based simulation with the Robotnik Kairos as a robotic agent. For a fair comparison, our evaluation considers an equal computational demand for every learning approach (i.e., the same number of interactions and difficulty of the environments) and confirms that our CL-based method that uses ToL outperforms the E2E methodology. In particular, we improve the average success rate and the safety of the trained policy, resulting in 10 further confirm these results, we employ a formal verification tool to quantify the number of correct behaviors of Reinforcement Learning policies over desired specifications.

READ FULL TEXT

page 5

page 6

research
12/16/2021

Benchmarking Safe Deep Reinforcement Learning in Aquatic Navigation

We propose a novel benchmark environment for Safe Reinforcement Learning...
research
03/06/2023

Constrained Reinforcement Learning and Formal Verification for Safe Colonoscopy Navigation

The field of robotic Flexible Endoscopes (FEs) has progressed significan...
research
02/09/2023

Learning Complex Teamwork Tasks using a Sub-task Curriculum

Training a team to complete a complex task via multi-agent reinforcement...
research
03/16/2021

Sparse Curriculum Reinforcement Learning for End-to-End Driving

Deep reinforcement Learning for end-to-end driving is limited by the nee...
research
06/17/2019

Robotic Navigation using Entropy-Based Exploration

Robotic navigation concerns the task in which a robot should be able to ...
research
06/24/2020

Explainable robotic systems: Interpreting outcome-focused actions in a reinforcement learning scenario

Robotic systems are more present in our society every day. In human-robo...
research
04/14/2022

GloCAL: Glocalized Curriculum-Aided Learning of Multiple Tasks with Application to Robotic Grasping

The domain of robotics is challenging to apply deep reinforcement learni...

Please sign up or login with your details

Forgot password? Click here to reset