Reinforcement Learning based Beamforming for Massive MIMO Radar Multi-target Detection

by   Aya Mostafa Ahmed, et al.

This paper considers the problem of multi-target detection for massive multiple input multiple output (MMIMO) cognitive radar (CR). The concept of CR is based on the perception-action cycle that senses and intelligently adapts to the dynamic environment in order to optimally satisfy a specific mission. However, this usually requires a priori knowledge of the environmental model, which is not available in most cases. We propose a reinforcement learning (RL) based algorithm for cognitive beamforming in the presence of unknown disturbance statistics. The radar acts as an agent which continuously senses the unknown environment (i.e., targets and disturbance). Consequently, it optimizes the beamformers through tailoring the beampattern based on the acquired information. Furthermore, we propose a solution to the beamforming optimization problem with less complexity than the existing methods. Numerical simulations are performed to assess the performance of the proposed RL-based algorithm in both stationary and dynamic environments. The RL based beamforming is compared to the conventional omnidirectional approach with equal power allocation. As highlighted by the proposed numerical results, our RL-based beamformer greatly outperforms the omnidirectional one in terms of target detection performance. The performance improvement is even more remarkable under environmentally harsh conditions such as low SNR, heavy-tailed disturbance and rapidly changing scenarios.



There are no comments yet.


page 1

page 8

page 10

page 11


Reinforcement Learning Assisted Beamforming for Inter-cell Interference Mitigation in 5G Massive MIMO Networks

Beamforming is an essential technology in the 5G massive multiple-input-...

Joint CSI Estimation, Beamforming and Scheduling Design for Wideband Massive MIMO System

This paper proposes a novel approach for designing channel estimation, b...

Simultaneous Multi-User MIMO Communications and Multi-Target Tracking with Full Duplex Radios

In this paper, we present an Integrated Sensing and Communications (ISAC...

Massive MIMO Multicast Beamforming Via Accelerated Random Coordinate Descent

One key feature of massive multiple-input multiple-output systems is the...

Joint Beamforming and Association Design for MIMO Radar

A critical task of a radar receiver is data association, which assigns r...

Meta-Cognition. An Inverse-Inverse Reinforcement Learning Approach for Cognitive Radars

This paper considers meta-cognitive radars in an adversarial setting. A ...

Multi-Radar Tracking Optimization for Collaborative Combat

Smart Grids of collaborative netted radars accelerate kill chains throug...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.