Deep reinforcement learning approach to MIMO precoding problem: Optimality and Robustness

06/30/2020
by   Heunchul Lee, et al.
0

In this paper, we propose a deep reinforcement learning (RL)-based precoding framework that can be used to learn an optimal precoding policy for complex multiple-input multiple-output (MIMO) precoding problems. We model the precoding problem for a single-user MIMO system as an RL problem in which a learning agent sequentially selects the precoders to serve the environment of MIMO system based on contextual information about the environmental conditions, while simultaneously adapting the precoder selection policy based on the reward feedback from the environment to maximize a numerical reward signal. We develop the RL agent with two canonical deep RL (DRL) algorithms, namely deep Q-network (DQN) and deep deterministic policy gradient (DDPG). To demonstrate the optimality of the proposed DRL-based precoding framework, we explicitly consider a simple MIMO environment for which the optimal solution can be obtained analytically and show that DQN- and DDPG-based agents can learn the near-optimal policy to map the environment state of MIMO system to a precoder that maximizes the reward function, respectively, in the codebook-based and non-codebook based MIMO precoding systems. Furthermore, to investigate the robustness of DRL-based precoding framework, we examine the performance of the two DRL algorithms in a complex MIMO environment, for which the optimal solution is not known. The numerical results confirm the effectiveness of the DRL-based precoding framework and show that the proposed DRL-based framework can outperform the conventional approximation algorithm in the complex MIMO environment.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 1

page 2

page 3

page 4

01/05/2021

Joint Deep Reinforcement Learning and Unfolding: Beam Selection and Precoding for mmWave Multiuser MIMO with Lens Arrays

The millimeter wave (mmWave) multiuser multiple-input multiple-output (M...
02/13/2020

Simultaneous Energy Harvesting and Information Transmission in a MIMO Full-Duplex System: A Machine Learning-Based Design

We propose a multiple-input multiple-output (MIMO)-based full-duplex (FD...
11/05/2021

Deep-Learning Based Linear Precoding for MIMO Channels with Finite-Alphabet Signaling

This paper studies the problem of linear precoding for multiple-input mu...
12/17/2018

Optimizing Distributed MIMO Wi-Fi Networks with Deep Reinforcement Learning

This paper explores the feasibility of leveraging concepts from deep rei...
09/10/2021

Multi-agent deep reinforcement learning (MADRL) meets multi-user MIMO systems

A multi-agent deep reinforcement learning (MADRL) is a promising approac...
12/02/2020

Pareto Deterministic Policy Gradients and Its Application in 5G Massive MIMO Networks

In this paper, we consider jointly optimizing cell load balance and netw...
06/14/2019

Self-Tuning Sectorization: Deep Reinforcement Learning Meets Broadcast Beam Optimization

Beamforming in multiple input multiple output (MIMO) systems is one of t...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.