ViWi: A Deep Learning Dataset Framework for Vision-Aided Wireless Communications

11/14/2019
by   Muhammad Alrabeiah, et al.
12

The growing role that artificial intelligence and specifically machine learning is playing in shaping the future of wireless communications has opened up many new and intriguing research directions. This paper motivates the research in the novel direction of vision-aided wireless communications, which aims at leveraging visual sensory information in tackling wireless communication problems. Like any new research direction driven by machine learning, obtaining a development dataset poses the first and most important challenge to vision-aided wireless communications. This paper addresses this issue by introducing the Vision-Wireless (ViWi) dataset framework. It is developed to be a parametric, systematic, and scalable data generation framework. It utilizes advanced 3D-modeling and ray-tracing softwares to generate high-fidelity synthetic wireless and vision data samples for the same scenes. The result is a framework that does not only offer a way to generate training and testing datasets but helps provide a common ground on which the quality of different machine learning-powered solutions could be assessed.

READ FULL TEXT

page 1

page 2

page 3

page 4

page 5

research
02/06/2020

ViWi Vision-Aided mmWave Beam Tracking: Dataset, Task, and Baseline Solutions

Vision-aided wireless communication is motivated by the recent advances ...
research
02/18/2021

Vision-Aided 6G Wireless Communications: Blockage Prediction and Proactive Handoff

The sensitivity to blockages is a key challenge for the high-frequency (...
research
03/01/2020

Scalable Learning Paradigms for Data-Driven Wireless Communication

The marriage of wireless big data and machine learning techniques revolu...
research
07/01/2020

OrchideaSOL: a dataset of extended instrumental techniques for computer-aided orchestration

This paper introduces OrchideaSOL, a free dataset of samples of extended...
research
12/05/2022

WAIR-D: Wireless AI Research Dataset

It is a common sense that datasets with high-quality data samples play a...
research
07/18/2020

Deep Multimodal Learning: Merging Sensory Data for Massive MIMO Channel Prediction

Existing work in intelligent communications has recently made preliminar...
research
01/26/2023

Real-Time Digital Twins: Vision and Research Directions for 6G and Beyond

This article presents a vision where real-time digital twins of the phys...

Please sign up or login with your details

Forgot password? Click here to reset