DeFIX: Detecting and Fixing Failure Scenarios with Reinforcement Learning in Imitation Learning Based Autonomous Driving

10/29/2022
by   Resul Dagdanov, et al.
0

Safely navigating through an urban environment without violating any traffic rules is a crucial performance target for reliable autonomous driving. In this paper, we present a Reinforcement Learning (RL) based methodology to DEtect and FIX (DeFIX) failures of an Imitation Learning (IL) agent by extracting infraction spots and re-constructing mini-scenarios on these infraction areas to train an RL agent for fixing the shortcomings of the IL approach. DeFIX is a continuous learning framework, where extraction of failure scenarios and training of RL agents are executed in an infinite loop. After each new policy is trained and added to the library of policies, a policy classifier method effectively decides on which policy to activate at each step during the evaluation. It is demonstrated that even with only one RL agent trained on failure scenario of an IL agent, DeFIX method is either competitive or does outperform state-of-the-art IL and RL based autonomous urban driving benchmarks. We trained and validated our approach on the most challenging map (Town05) of CARLA simulator which involves complex, realistic, and adversarial driving scenarios. The source code is publicly available at https://github.com/data-and-decision-lab/DeFIX

READ FULL TEXT

page 1

page 5

research
02/02/2020

Deep Reinforcement Learning for Autonomous Driving: A Survey

With the development of deep representation learning, the domain of rein...
research
05/31/2022

Human-AI Shared Control via Frequency-based Policy Dissection

Human-AI shared control allows human to interact and collaborate with AI...
research
09/18/2023

Privileged to Predicted: Towards Sensorimotor Reinforcement Learning for Urban Driving

Reinforcement Learning (RL) has the potential to surpass human performan...
research
07/01/2020

Reinforcement Learning based Control of Imitative Policies for Near-Accident Driving

Autonomous driving has achieved significant progress in recent years, bu...
research
01/20/2023

On Multi-Agent Deep Deterministic Policy Gradients and their Explainability for SMARTS Environment

Multi-Agent RL or MARL is one of the complex problems in Autonomous Driv...
research
04/26/2023

Can Agents Run Relay Race with Strangers? Generalization of RL to Out-of-Distribution Trajectories

In this paper, we define, evaluate, and improve the “relay-generalizatio...
research
05/24/2022

Learning to Drive Using Sparse Imitation Reinforcement Learning

In this paper, we propose Sparse Imitation Reinforcement Learning (SIRL)...

Please sign up or login with your details

Forgot password? Click here to reset