Deep Multimodal Learning: Merging Sensory Data for Massive MIMO Channel Prediction

07/18/2020
by   Yuwen Yang, et al.
0

Existing work in intelligent communications has recently made preliminary attempts to utilize multi-source sensing information (MSI) to improve the system performance. However, the research on MSI aided intelligent communications has not yet explored how to integrate and fuse the multimodal sensory data, which motivates us to develop a systematic framework for wireless communications based on deep multimodal learning (DML). In this paper, we first present complete descriptions and heuristic understandings on the framework of DML based wireless communications, where core design choices are analyzed in the view of communications. Then, we develop several DML based architectures for channel prediction in massive multiple-input multiple-output (MIMO) systems that leverage various modality combinations and fusion levels. The case study of massive MIMO channel prediction offers an important example that can be followed in developing other DML based communication technologies. Simulations results demonstrate that the proposed DML framework can effectively exploit the constructive and complementary information of multimodal sensory data in various wireless communication scenarios.

READ FULL TEXT

page 6

page 10

page 11

page 16

page 17

page 20

page 21

page 29

research
02/06/2023

Mobile Cell-Free Massive MIMO: Challenges, Solutions, and Future Directions

Cell-free (CF) massive multiple-input multiple-output (MIMO) systems, wh...
research
10/17/2022

Massive MIMO Channel Prediction Via Meta-Learning and Deep Denoising: Is a Small Dataset Enough?

Accurate channel knowledge is critical in massive multiple-input multipl...
research
07/08/2019

A Survey of Reconfigurable Intelligent Surfaces: Towards 6G Wireless Communication Networks with Massive MIMO 2.0

Reconfigurable intelligent surfaces (RISs) tune wireless environments to...
research
01/29/2020

Deep Channel Learning For Large Intelligent Surfaces Aided mm-Wave Massive MIMO Systems

This letter presents the first work introducing a deep learning (DL) fra...
research
12/25/2019

Channel Estimation and Hybrid Beamforming for Reconfigurable Intelligent Surfaces Assisted THz Communications

Terahertz (THz) communications are promising to be the next frontier for...
research
07/08/2019

A Survey of Intelligent Reflecting Surfaces (IRSs): Towards 6G Wireless Communication Networks with Massive MIMO 2.0

Intelligent reflecting surfaces (IRSs) tune wireless environments to inc...
research
11/14/2019

ViWi: A Deep Learning Dataset Framework for Vision-Aided Wireless Communications

The growing role that artificial intelligence and specifically machine l...

Please sign up or login with your details

Forgot password? Click here to reset