Shared Information-Based Safe And Efficient Behavior Planning For Connected Autonomous Vehicles

02/08/2023
by   Songyang Han, et al.
0

The recent advancements in wireless technology enable connected autonomous vehicles (CAVs) to gather data via vehicle-to-vehicle (V2V) communication, such as processed LIDAR and camera data from other vehicles. In this work, we design an integrated information sharing and safe multi-agent reinforcement learning (MARL) framework for CAVs, to take advantage of the extra information when making decisions to improve traffic efficiency and safety. We first use weight pruned convolutional neural networks (CNN) to process the raw image and point cloud LIDAR data locally at each autonomous vehicle, and share CNN-output data with neighboring CAVs. We then design a safe actor-critic algorithm that utilizes both a vehicle's local observation and the information received via V2V communication to explore an efficient behavior planning policy with safety guarantees. Using the CARLA simulator for experiments, we show that our approach improves the CAV system's efficiency in terms of average velocity and comfort under different CAV ratios and different traffic densities. We also show that our approach avoids the execution of unsafe actions and always maintains a safe distance from other vehicles. We construct an obstacle-at-corner scenario to show that the shared vision can help CAVs to observe obstacles earlier and take action to avoid traffic jams.

READ FULL TEXT

page 4

page 7

research
10/05/2022

Spatial-Temporal-Aware Safe Multi-Agent Reinforcement Learning of Connected Autonomous Vehicles in Challenging Scenarios

Communication technologies enable coordination among connected and auton...
research
07/12/2021

Altruistic Maneuver Planning for Cooperative Autonomous Vehicles Using Multi-agent Advantage Actor-Critic

With the adoption of autonomous vehicles on our roads, we will witness a...
research
10/31/2022

Safe and Efficient Manoeuvring for Emergency Vehicles in Autonomous Traffic using Multi-Agent Proximal Policy Optimisation

Manoeuvring in the presence of emergency vehicles is still a major issue...
research
03/05/2023

Multi-vehicle Platoon Overtaking Using NoisyNet Multi-Agent Deep Q-Learning Network

With the recent advancements in Vehicle-to-Vehicle communication technol...
research
04/07/2022

Situation Awareness for Autonomous Vehicles Using Blockchain-based Service Cooperation

Efficient Vehicle-to-Everything enabling cooperation and enhanced decisi...
research
11/28/2020

Rules of the Road: Towards Safety and Liveness Guarantees for Autonomous Vehicles

The ability to guarantee safety and progress for all vehicles is vital t...
research
09/20/2023

Safe and Robust Multi-Agent Reinforcement Learning for Connected Autonomous Vehicles under State Perturbations

Sensing and communication technologies have enhanced learning-based deci...

Please sign up or login with your details

Forgot password? Click here to reset