Vision-Aided Beam Tracking: Explore the Proper Use of Camera Images with Deep Learning

09/29/2021
by   Yu Tian, et al.
0

We investigate the problem of wireless beam tracking on mmWave bands with the assistance of camera images. In particular, based on the user's beam indices used and camera images taken in the trajectory, we predict the optimal beam indices in the next few time spots. To resolve this problem, we first reformulate the "ViWi" dataset in [1] to get rid of the image repetition problem. Then we develop a deep learning approach and investigate various model components to achieve the best performance. Finally, we explore whether, when, and how to use the image for better beam prediction. To answer this question, we split the dataset into three clusters – (LOS, light NLOS, serious NLOS)-like – based on the standard deviation of the beam sequence. With experiments we demonstrate that using the image indeed helps beam tracking especially when the user is in serious NLOS, and the solution relies on carefully-designed dataset for training a model. Generally speaking, including NLOS-like data for training a model does not benefit beam tracking of the user in LOS, but including light NLOS-like data for training a model benefits beam tracking of the user in serious NLOS.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/10/2022

LiDAR Aided Future Beam Prediction in Real-World Millimeter Wave V2I Communications

This paper presents the first large-scale real-world evaluation for usin...
research
08/14/2023

Camera Based mmWave Beam Prediction: Towards Multi-Candidate Real-World Scenarios

Leveraging sensory information to aid the millimeter-wave (mmWave) and s...
research
08/20/2023

Vehicle Cameras Guide mmWave Beams: Approach and Real-World V2V Demonstration

Accurately aligning millimeter-wave (mmWave) and terahertz (THz) narrow ...
research
11/29/2021

Computer Vision Aided Beam Tracking in A Real-World Millimeter Wave Deployment

Millimeter-wave (mmWave) and terahertz (THz) communications require beam...
research
08/12/2018

A simulation study to distinguish prompt photon from π^0 and beam halo in a granular calorimeter using deep networks

In a hadron collider environment identification of prompt photons origin...
research
09/16/2022

Beam Tracking for Dynamic mmWave Channels: A New Training Beam Sequence Design Approach

In this paper, we develop an efficient training beam sequence design app...
research
05/29/2022

Vision-Assisted User Clustering for Robust mmWave-NOMA Systems

NOMA is an emerging paradigm for B5G systems to support a large number a...

Please sign up or login with your details

Forgot password? Click here to reset