Multi-Agent Deep Reinforcement Learning in Vehicular OCC

05/05/2022
by   Amirul Islam, et al.
11

Optical camera communications (OCC) has emerged as a key enabling technology for the seamless operation of future autonomous vehicles. In this paper, we introduce a spectral efficiency optimization approach in vehicular OCC. Specifically, we aim at optimally adapting the modulation order and the relative speed while respecting bit error rate and latency constraints. As the optimization problem is NP-hard problem, we model the optimization problem as a Markov decision process (MDP) to enable the use of solutions that can be applied online. We then relaxed the constrained problem by employing Lagrange relaxation approach before solving it by multi-agent deep reinforcement learning (DRL). We verify the performance of our proposed scheme through extensive simulations and compare it with various variants of our approach and a random method. The evaluation shows that our system achieves significantly higher sum spectral efficiency compared to schemes under comparison.

READ FULL TEXT
research
11/20/2019

Ultra-Reliable and Low-Latency Vehicular Communication using Optical Camera Communications

Optical camera communication (OCC) has emerged as a key enabling technol...
research
01/27/2022

Network slicing for vehicular communications: a multi-agent deep reinforcement learning approach

This paper studies the multi-agent resource allocation problem in vehicu...
research
09/07/2020

Centralized Distributed Deep Reinforcement Learning Methods for Downlink Sum-Rate Optimization

For a multi-cell, multi-user, cellular network downlink sum-rate maximiz...
research
11/14/2022

Parallel Automatic History Matching Algorithm Using Reinforcement Learning

Reformulating the history matching problem from a least-square mathemati...
research
02/06/2021

Multi-Agent Deep Reinforcement Learning for Request Dispatching in Distributed-Controller Software-Defined Networking

Recently, distributed controller architectures have been quickly gaining...
research
06/26/2023

Multi-Agent Deep Reinforcement Learning for Dynamic Avatar Migration in AIoT-enabled Vehicular Metaverses with Trajectory Prediction

Avatars, as promising digital assistants in Vehicular Metaverses, can en...
research
01/20/2022

EdgeMap: CrowdSourcing High Definition Map in Automotive Edge Computing

High definition (HD) map needs to be updated frequently to capture road ...

Please sign up or login with your details

Forgot password? Click here to reset