Wireless Image Retrieval at the Edge

07/21/2020
by   Mikolaj Jankowski, et al.
0

We study the image retrieval problem at the wireless edge, where an edge device captures an image, which is then used to retrieve similar images from an edge server. These can be images of the same person or a vehicle taken from other cameras at different times and locations. Our goal is to maximize the accuracy of the retrieval task under power and bandwidth constraints over the wireless link. Due to the stringent delay constraint of the underlying application, sending the whole image at a sufficient quality is not possible. To address this problem we propose two communication schemes, based on digital and analog communications, respectively. In the digital approach, we first propose a deep neural network (DNN) for retrieval-oriented image compression, whose output bit sequence is transmitted over the channel as reliably as possible using conventional channel codes. In the analog joint source and channel coding (JSCC) approach, the feature vectors are directly mapped into channel symbols. We evaluate both schemes on image based re-identification (re-ID) tasks under different channel conditions, including both static and fading channels. We show that the JSCC scheme significantly increases the end-to-end accuracy, speeds up the encoding process, and provides graceful degradation with channel conditions. The proposed architecture is evaluated through extensive simulations on different datasets and channel conditions, as well as through ablation studies.

READ FULL TEXT

Please sign up or login with your details

Forgot password? Click here to reset