Image-Based Conditioning for Action Policy Smoothness in Autonomous Miniature Car Racing with Reinforcement Learning

05/19/2022

∙

In recent years, deep reinforcement learning has achieved significant results in low-level controlling tasks. However, the problem of control smoothness has less attention. In autonomous driving, unstable control is inevitable since the vehicle might suddenly change its actions. This problem will lower the controlling system's efficiency, induces excessive mechanical wear, and causes uncontrollable, dangerous behavior to the vehicle. In this paper, we apply the Conditioning for Action Policy Smoothness (CAPS) with image-based input to smooth the control of an autonomous miniature car racing. Applying CAPS and sim-to-real transfer methods helps to stabilize the control at a higher speed. Especially, the agent with CAPS and CycleGAN reduces 21.80 finishing lap time. Moreover, we also conduct extensive experiments to analyze the impact of CAPS components.

READ FULL TEXT

Image-Based Conditioning for Action Policy Smoothness in Autonomous Miniature Car Racing with Reinforcement Learning

Image-based Regularization for Action Smoothness in Autonomous Miniature Racing Car with Deep Reinforcement Learning

Bilateral Deep Reinforcement Learning Approach for Better-than-human Car Following Model

Regularizing Action Policies for Smooth Control with Reinforcement Learning

GridSim: A Vehicle Kinematics Engine for Deep Neuroevolutionary Control in Autonomous Driving

Tackling Real-World Autonomous Driving using Deep Reinforcement Learning

Quadratic Q-network for Learning Continuous Control for Autonomous Vehicles

Incremental Reinforcement Learning --- a New Continuous Reinforcement Learning Frame Based on Stochastic Differential Equation methods

Image-Based Conditioning for Action Policy Smoothness in Autonomous Miniature Car Racing with Reinforcement Learning

Related Research

Image-based Regularization for Action Smoothness in Autonomous Miniature Racing Car with Deep Reinforcement Learning

Bilateral Deep Reinforcement Learning Approach for Better-than-human Car Following Model

Regularizing Action Policies for Smooth Control with Reinforcement Learning

GridSim: A Vehicle Kinematics Engine for Deep Neuroevolutionary Control in Autonomous Driving

Tackling Real-World Autonomous Driving using Deep Reinforcement Learning

Quadratic Q-network for Learning Continuous Control for Autonomous Vehicles

Incremental Reinforcement Learning --- a New Continuous Reinforcement Learning Frame Based on Stochastic Differential Equation methods