ViWi Vision-Aided mmWave Beam Tracking: Dataset, Task, and Baseline Solutions

02/06/2020
by   Muhammad Alrabeiah, et al.
0

Vision-aided wireless communication is motivated by the recent advances in deep learning and computer vision as well as the increasing dependence on line-of-sight links in millimeter wave (mmWave) and terahertz systems. By leveraging vision, this new research direction enables an interesting set of new capabilities such as vision-aided mmWave beam and blockage prediction, proactive hand-off, and resource allocation among others. These capabilities have the potential of reliably supporting highly-mobile applications such as vehicular/drone communications and wireless virtual/augmented reality in mmWave and terahertz systems. Investigating these interesting applications, however, requires the development of special dataset and machine learning tasks. Based on the Vision-Wireless (ViWi) dataset generation framework [1], this paper develops an advanced and realistic scenario/dataset that features multiple base stations, mobile users, and rich dynamics. Enabled by this dataset, the paper defines the vision-wireless mmWave beam tracking task (ViWi-BT) and proposes a baseline solution that can provide an initial benchmark for the future ViWi-BT algorithms.

READ FULL TEXT

page 1

page 2

research
11/14/2019

Millimeter Wave Base Stations with Cameras: Vision Aided Beam and Blockage Prediction

This paper investigates a novel research direction that leverages vision...
research
11/14/2019

ViWi: A Deep Learning Dataset Framework for Vision-Aided Wireless Communications

The growing role that artificial intelligence and specifically machine l...
research
11/14/2022

Millimeter Wave Drones with Cameras: Computer Vision Aided Wireless Beam Prediction

Millimeter wave (mmWave) and terahertz (THz) drones have the potential t...
research
02/18/2019

DeepMIMO: A Generic Deep Learning Dataset for Millimeter Wave and Massive MIMO Applications

Machine learning tools are finding interesting applications in millimete...
research
04/27/2018

Deep Learning Coordinated Beamforming for Highly-Mobile Millimeter Wave Systems

Supporting high mobility in millimeter wave (mmWave) systems enables a w...
research
09/15/2022

Multi-Modal Beam Prediction Challenge 2022: Towards Generalization

Beam management is a challenging task for millimeter wave (mmWave) and s...
research
12/29/2019

A Machine Learning Solution for Beam Tracking in mmWave Systems

Utilizing millimeter-wave (mmWave) frequencies for wireless communicatio...

Please sign up or login with your details

Forgot password? Click here to reset