Millimeter Wave Drones with Cameras: Computer Vision Aided Wireless Beam Prediction

11/14/2022
by   Gouranga Charan, et al.
0

Millimeter wave (mmWave) and terahertz (THz) drones have the potential to enable several futuristic applications such as coverage extension, enhanced security monitoring, and disaster management. However, these drones need to deploy large antenna arrays and use narrow directive beams to maintain a sufficient link budget. The large beam training overhead associated with these arrays makes adjusting these narrow beams challenging for highly-mobile drones. To address these challenges, this paper proposes a vision-aided machine learning-based approach that leverages visual data collected from cameras installed on the drones to enable fast and accurate beam prediction. Further, to facilitate the evaluation of the proposed solution, we build a synthetic drone communication dataset consisting of co-existing wireless and visual data. The proposed vision-aided solution achieves a top-1 beam prediction accuracy of ≈ 91% and close to 100% top-3 accuracy. These results highlight the efficacy of the proposed solution towards enabling highly mobile mmWave/THz drone communication.

READ FULL TEXT

page 1

page 2

page 3

page 4

page 5

research
11/15/2021

Vision-Position Multi-Modal Beam Prediction Using Real Millimeter Wave Datasets

Enabling highly-mobile millimeter wave (mmWave) and terahertz (THz) wire...
research
11/14/2019

Millimeter Wave Base Stations with Cameras: Vision Aided Beam and Blockage Prediction

This paper investigates a novel research direction that leverages vision...
research
02/13/2023

Environment Semantic Aided Communication: A Real World Demonstration for Beam Prediction

Millimeter-wave (mmWave) and terahertz (THz) communication systems adopt...
research
02/06/2020

ViWi Vision-Aided mmWave Beam Tracking: Dataset, Task, and Baseline Solutions

Vision-aided wireless communication is motivated by the recent advances ...
research
05/18/2022

Position Aided Beam Prediction in the Real World: How Useful GPS Locations Actually Are?

Millimeter-wave (mmWave) communication systems rely on narrow beams for ...
research
11/13/2020

3-D Motion Capture of an Unmodified Drone with Single-chip Millimeter Wave Radar

Accurate motion capture of aerial robots in 3-D is a key enabler for aut...
research
09/15/2022

Multi-Modal Beam Prediction Challenge 2022: Towards Generalization

Beam management is a challenging task for millimeter wave (mmWave) and s...

Please sign up or login with your details

Forgot password? Click here to reset