Investigating Value of Curriculum Reinforcement Learning in Autonomous Driving Under Diverse Road and Weather Conditions

by   Anil Ozturk, et al.

Applications of reinforcement learning (RL) are popular in autonomous driving tasks. That being said, tuning the performance of an RL agent and guaranteeing the generalization performance across variety of different driving scenarios is still largely an open problem. In particular, getting good performance on complex road and weather conditions require exhaustive tuning and computation time. Curriculum RL, which focuses on solving simpler automation tasks in order to transfer knowledge to complex tasks, is attracting attention in RL community. The main contribution of this paper is a systematic study for investigating the value of curriculum reinforcement learning in autonomous driving applications. For this purpose, we setup several different driving scenarios in a realistic driving simulator, with varying road complexity and weather conditions. Next, we train and evaluate performance of RL agents on different sequences of task combinations and curricula. Results show that curriculum RL can yield significant gains in complex driving tasks, both in terms of driving performance and sample complexity. Results also demonstrate that different curricula might enable different benefits, which hints future research directions for automated curriculum training.


page 1

page 3

page 4


State Dropout-Based Curriculum Reinforcement Learning for Self-Driving at Unsignalized Intersections

Traversing intersections is a challenging problem for autonomous vehicle...

Hierarchical Program-Triggered Reinforcement Learning Agents For Automated Driving

Recent advances in Reinforcement Learning (RL) combined with Deep Learni...

Self-Paced Deep Reinforcement Learning

Generalization and reuse of agent behaviour across a variety of learning...

Federated Transfer Reinforcement Learning for Autonomous Driving

Reinforcement learning (RL) is widely used in autonomous driving tasks a...

Persistent Reinforcement Learning via Subgoal Curricula

Reinforcement learning (RL) promises to enable autonomous acquisition of...

GRI: General Reinforced Imitation and its Application to Vision-Based Autonomous Driving

Deep reinforcement learning (DRL) has been demonstrated to be effective ...

OTTR: Off-Road Trajectory Tracking using Reinforcement Learning

In this work, we present a novel Reinforcement Learning (RL) algorithm f...