Density-Aware Federated Imitation Learning for Connected and Automated Vehicles with Unsignalized Intersection

05/05/2021
by   Tianhao Wu, et al.
0

Intelligent Transportation System (ITS) has become one of the essential components in Industry 4.0. As one of the critical indicators of ITS, efficiency has attracted wide attention from researchers. However, the next generation of urban traffic carried by multiple transport service providers may prohibit the raw data interaction among multiple regions for privacy reasons, easily ignored in the existing research. This paper puts forward a federated learning-based vehicle control framework to solve the above problem, including interactors, trainers, and an aggregator. In addition, the density-aware model aggregation method is utilized in this framework to improve vehicle control. What is more, to promote the performance of the end-to-end learning algorithm in the safety aspect, this paper proposes an imitation learning algorithm, which can obtain collision avoidance capabilities from a set of collision avoidance rules. Furthermore, a loss-aware experience selection strategy is also explored, reducing the communication overhead between the interactors and the trainers via extra computing. Finally, the experiment results demonstrate that the proposed imitation learning algorithm obtains the ability to avoid collisions and reduces discomfort by 55.71 aggregation can further reduce discomfort by 41.37 selection scheme can reduce the communication overhead by 12.80 model convergence.

READ FULL TEXT

page 1

page 3

page 9

research
06/02/2023

Cooperative Collision Avoidance in a Connected Vehicle Environment

Connected vehicle (CV) technology is among the most heavily researched a...
research
08/04/2023

Vehicles Control: Collision Avoidance using Federated Deep Reinforcement Learning

In the face of growing urban populations and the escalating number of ve...
research
07/09/2021

Adversarial Mixture Density Networks: Learning to Drive Safely from Collision Data

Imitation learning has been widely used to learn control policies for au...
research
11/25/2020

Experiments in Autonomous Driving Through Imitation Learning

This report demonstrates several methods used to make a self-driving veh...
research
05/07/2019

Uncertainty-Aware Data Aggregation for Deep Imitation Learning

Estimating statistical uncertainties allows autonomous agents to communi...
research
06/14/2020

Active Imitation Learning from Multiple Non-Deterministic Teachers: Formulation, Challenges, and Algorithms

We formulate the problem of learning to imitate multiple, non-determinis...
research
09/30/2019

Tensor-based Cooperative Control for Large Scale Multi-intersection Traffic Signal Using Deep Reinforcement Learning and Imitation Learning

Traffic signal control has long been considered as a critical topic in i...

Please sign up or login with your details

Forgot password? Click here to reset