Wireless Image Retrieval at the Edge

07/21/2020
by   Mikolaj Jankowski, et al.
0

We study the image retrieval problem at the wireless edge, where an edge device captures an image, which is then used to retrieve similar images from an edge server. These can be images of the same person or a vehicle taken from other cameras at different times and locations. Our goal is to maximize the accuracy of the retrieval task under power and bandwidth constraints over the wireless link. Due to the stringent delay constraint of the underlying application, sending the whole image at a sufficient quality is not possible. To address this problem we propose two communication schemes, based on digital and analog communications, respectively. In the digital approach, we first propose a deep neural network (DNN) for retrieval-oriented image compression, whose output bit sequence is transmitted over the channel as reliably as possible using conventional channel codes. In the analog joint source and channel coding (JSCC) approach, the feature vectors are directly mapped into channel symbols. We evaluate both schemes on image based re-identification (re-ID) tasks under different channel conditions, including both static and fading channels. We show that the JSCC scheme significantly increases the end-to-end accuracy, speeds up the encoding process, and provides graceful degradation with channel conditions. The proposed architecture is evaluated through extensive simulations on different datasets and channel conditions, as well as through ablation studies.

READ FULL TEXT
research
10/28/2019

Deep Joint Source-Channel Coding for Wireless Image Retrieval

Motivated by surveillance applications with wireless cameras or drones, ...
research
11/03/2020

Deep Joint Transmission-Recognition for Multi-View Cameras

We propose joint transmission-recognition schemes for efficient inferenc...
research
01/16/2023

High-bandwidth Close-Range Information Transport through Light Pipes

Image retrieval after propagation through multi-mode fibers is gaining a...
research
06/16/2022

DeepJSCC-Q: Constellation Constrained Deep Joint Source-Channel Coding

Recent works have shown that modern machine learning techniques can prov...
research
11/25/2021

DeepJSCC-Q: Channel Input Constrained Deep Joint Source-Channel Coding

Recent works have shown that the task of wireless transmission of images...
research
05/24/2021

AirNet: Neural Network Transmission over the Air

State-of-the-art performance for many emerging edge applications is achi...
research
09/02/2022

Semantic Communication-Empowered Physical-layer Network Coding

In a two-way relay channel (TWRC), physical-layer network coding (PNC) d...

Please sign up or login with your details

Forgot password? Click here to reset