AVDDPG: Federated reinforcement learning applied to autonomous platoon control

07/05/2022
by   Christian Boin, et al.
0

Since 2016 federated learning (FL) has been an evolving topic of discussion in the artificial intelligence (AI) research community. Applications of FL led to the development and study of federated reinforcement learning (FRL). Few works exist on the topic of FRL applied to autonomous vehicle (AV) platoons. In addition, most FRL works choose a single aggregation method (usually weight or gradient aggregation). We explore FRL's effectiveness as a means to improve AV platooning by designing and implementing an FRL framework atop a custom AV platoon environment. The application of FRL in AV platooning is studied under two scenarios: (1) Inter-platoon FRL (Inter-FRL) where FRL is applied to AVs across different platoons; (2) Intra-platoon FRL (Intra-FRL) where FRL is applied to AVs within a single platoon. Both Inter-FRL and Intra-FRL are applied to a custom AV platooning environment using both gradient and weight aggregation to observe the performance effects FRL can have on AV platoons relative to an AV platooning environment trained without FRL. It is concluded that Intra-FRL using weight aggregation (Intra-FRLWA) provides the best performance for controlling an AV platoon. In addition, we found that weight aggregation in FRL for AV platooning provides increases in performance relative to gradient aggregation. Finally, a performance analysis is conducted for Intra-FRLWA versus a platooning environment without FRL for platoons of length 3, 4 and 5 vehicles. It is concluded that Intra-FRLWA largely out-performs the platooning environment that is trained without FRL.

READ FULL TEXT

page 4

page 6

research
01/30/2023

Regularized Weight Aggregation in Networked Federated Learning for Glioblastoma Segmentation

In federated learning (FL), the global model at the server requires an e...
research
10/22/2020

Hierarchical Federated Learning through LAN-WAN Orchestration

Federated learning (FL) was designed to enable mobile phones to collabor...
research
06/14/2021

Dynamic Gradient Aggregation for Federated Domain Adaptation

In this paper, a new learning algorithm for Federated Learning (FL) is i...
research
08/06/2020

Federated Transfer Learning with Dynamic Gradient Aggregation

In this paper, a Federated Learning (FL) simulation platform is introduc...
research
03/23/2022

Adaptive Aggregation For Federated Learning

Advances in federated learning (FL) algorithms,along with technologies l...
research
01/26/2023

SuperFed: Weight Shared Federated Learning

Federated Learning (FL) is a well-established technique for privacy pres...

Please sign up or login with your details

Forgot password? Click here to reset