TinyLight: Adaptive Traffic Signal Control on Devices with Extremely Limited Resources

05/01/2022
by   Dong Xing, et al.
0

Recent advances in deep reinforcement learning (DRL) have largely promoted the performance of adaptive traffic signal control (ATSC). Nevertheless, regarding the implementation, most works are cumbersome in terms of storage and computation. This hinders their deployment on scenarios where resources are limited. In this work, we propose TinyLight, the first DRL-based ATSC model that is designed for devices with extremely limited resources. TinyLight first constructs a super-graph to associate a rich set of candidate features with a group of light-weighted network blocks. Then, to diminish the model's resource consumption, we ablate edges in the super-graph automatically with a novel entropy-minimized objective function. This enables TinyLight to work on a standalone microcontroller with merely 2KB RAM and 32KB ROM. We evaluate TinyLight on multiple road networks with real-world traffic demands. Experiments show that even with extremely limited resources, TinyLight still achieves competitive performance. The source code and appendix of this work can be found at <https://bit.ly/38hH8t8>.

READ FULL TEXT

page 3

page 6

page 12

research
11/14/2019

Deep Reinforcement Learning for Adaptive Traffic Signal Control

Many existing traffic signal controllers are either simple adaptive cont...
research
11/27/2018

Distributed traffic light control at uncoupled intersections with real-world topology by deep reinforcement learning

This work examines the implications of uncoupled intersections with loca...
research
03/02/2021

Deep Reinforcement Learning for URLLC data management on top of scheduled eMBB traffic

With the advent of 5G and the research into beyond 5G (B5G) networks, a ...
research
09/11/2023

A Comparative Analysis of Deep Reinforcement Learning-based xApps in O-RAN

The highly heterogeneous ecosystem of Next Generation (NextG) wireless c...
research
07/21/2021

A Deep Reinforcement Learning Approach for Fair Traffic Signal Control

Traffic signal control is one of the most effective methods of traffic m...
research
09/01/2023

How Does Forecasting Affect the Convergence of DRL Techniques in O-RAN Slicing?

The success of immersive applications such as virtual reality (VR) gamin...

Please sign up or login with your details

Forgot password? Click here to reset