Intelligent Traffic Light Control Using Distributed Multi-agent Q Learning

11/29/2017
by   Ying Liu, et al.
0

The combination of Artificial Intelligence (AI) and Internet-of-Things (IoT), which is denoted as AI-powered Internet-of-Things (AIoT), is capable of processing huge amount of data generated from a large number of devices and handling complex problems in social infrastructures. As AI and IoT technologies are becoming mature, in this paper, we propose to apply AIoT technologies for traffic light control, which is an essential component for intelligent transportation system, to improve the efficiency of smart city's road system. Specifically, various sensors such as surveillance cameras provide real-time information for intelligent traffic light control system to observe the states of both motorized traffic and non-motorized traffic. In this paper, we propose an intelligent traffic light control solution by using distributed multi-agent Q learning, considering the traffic information at the neighboring intersections as well as local motorized and non-motorized traffic, to improve the overall performance of the entire control system. By using the proposed multi-agent Q learning algorithm, our solution is targeting to optimize both the motorized and non-motorized traffic. In addition, we considered many constraints/rules for traffic light control in the real world, and integrate these constraints in the learning algorithm, which can facilitate the proposed solution to be deployed in real operational scenarios. We conducted numerical simulations for a real-world map with real-world traffic data. The simulation results show that our proposed solution outperforms existing solutions in terms of vehicle and pedestrian queue lengths, waiting time at intersections, and many other key performance metrics.

READ FULL TEXT

page 2

page 6

page 7

page 8

research
06/06/2023

From Data to Action: Exploring AI and IoT-driven Solutions for Smarter Cities

The emergence of smart cities demands harnessing advanced technologies l...
research
11/04/2019

Smart City Intelligent System Traffic Congestion Optimization using Internet Of Things

The raising level of traffic imposes a great demand in the growth of int...
research
11/21/2020

Computation harvesting in road traffic dynamics

Owing to recent advances in artificial intelligence and internet of thin...
research
12/21/2010

Automatic Estimation of the Exposure to Lateral Collision in Signalized Intersections using Video Sensors

Intersections constitute one of the most dangerous elements in road syst...
research
12/16/2022

Control and Placement of Finite-Resolution Intelligent Surfaces in IoT Systems with Imperfect CSI

In this paper, we study the advantages of using reconfigurable intellige...
research
12/22/2021

Collaborative adversary nodes learning on the logs of IoT devices in an IoT network

Artificial Intelligence (AI) development has encouraged many new researc...

Please sign up or login with your details

Forgot password? Click here to reset