When Wireless Communications Meet Computer Vision in Beyond 5G

10/13/2020
by   Takayuki Nishio, et al.
0

This article articulates the emerging paradigm, sitting at the confluence of computer vision and wireless communication, to enable beyond-5G/6G mission-critical applications (autonomous/remote-controlled vehicles, visuo-haptic VR, and other cyber-physical applications). First, drawing on recent advances in machine learning and the availability of non-RF data, vision-aided wireless networks are shown to significantly enhance the reliability of wireless communication without sacrificing spectral efficiency. In particular, we demonstrate how computer vision enables look-ahead prediction in a millimeter-wave channel blockage scenario, before the blockage actually happens. From a computer vision perspective, we highlight how radio frequency (RF) based sensing and imaging are instrumental in robustifying computer vision applications against occlusion and failure. This is corroborated via an RF-based image reconstruction use case, showcasing a receiver-side image failure correction resulting in reduced retransmission and latency. Taken together, this article sheds light on the much-needed convergence of RF and non-RF modalities to enable ultra-reliable communication and truly intelligent 6G networks.

READ FULL TEXT

page 1

page 4

page 6

research
01/27/2020

Extreme URLLC: Vision, Challenges, and Key Enablers

Notwithstanding the significant traction gained by ultra-reliable and lo...
research
01/13/2019

Light-Field for RF

Most computer vision systems and computational photography systems are v...
research
03/03/2022

Computer Vision Aided Blockage Prediction in Real-World Millimeter Wave Deployments

This paper provides the first real-world evaluation of using visual (RGB...
research
02/18/2021

Vision-Aided 6G Wireless Communications: Blockage Prediction and Proactive Handoff

The sensitivity to blockages is a key challenge for the high-frequency (...
research
12/31/2018

RF Jamming Classification using Relative Speed Estimation in Vehicular Wireless Networks

Wireless communications are vulnerable against radio frequency (RF) jamm...
research
05/30/2020

Optical wireless hybrid networks for 5G and beyond communications

The next 5 th generation (5G) and above ultra-high speed, ultra-low late...
research
07/04/2023

Immersive Media and Massive Twinning: Advancing Towards the Metaverse

The advent of the Metaverse concept has further expedited the evolution ...

Please sign up or login with your details

Forgot password? Click here to reset