Human Silhouette and Skeleton Video Synthesis through Wi-Fi signals

03/11/2022
by   Danilo Avola, et al.
0

The increasing availability of wireless access points (APs) is leading towards human sensing applications based on Wi-Fi signals as support or alternative tools to the widespread visual sensors, where the signals enable to address well-known vision-related problems such as illumination changes or occlusions. Indeed, using image synthesis techniques to translate radio frequencies to the visible spectrum can become essential to obtain otherwise unavailable visual data. This domain-to-domain translation is feasible because both objects and people affect electromagnetic waves, causing radio and optical frequencies variations. In literature, models capable of inferring radio-to-visual features mappings have gained momentum in the last few years since frequency changes can be observed in the radio domain through the channel state information (CSI) of Wi-Fi APs, enabling signal-based feature extraction, e.g., amplitude. On this account, this paper presents a novel two-branch generative neural network that effectively maps radio data into visual features, following a teacher-student design that exploits a cross-modality supervision strategy. The latter conditions signal-based features in the visual domain to completely replace visual data. Once trained, the proposed method synthesizes human silhouette and skeleton videos using exclusively Wi-Fi signals. The approach is evaluated on publicly available data, where it obtains remarkable results for both silhouette and skeleton videos generation, demonstrating the effectiveness of the proposed cross-modality supervision strategy.

READ FULL TEXT

page 5

page 12

page 13

page 14

research
11/21/2019

Simultaneous Implementation Features Extraction and Recognition Using C3D Network for WiFi-based Human Activity Recognition

Human actions recognition has attracted more and more people's attention...
research
11/12/2019

Wi-Fi Passive Person Re-Identification based on Channel State Information

With the increasing need for wireless data transfer, Wi-Fi networks have...
research
05/24/2023

On Correlated Knowledge Distillation for Monitoring Human Pose with Radios

In this work, we propose and develop a simple experimental testbed to st...
research
04/16/2021

OpenCSI: An Open-Source Dataset for Indoor Localization Using CSI-Based Fingerprinting

Many applications require accurate indoor localization. Fingerprint-base...
research
01/05/2016

Space-Time Representation of People Based on 3D Skeletal Data: A Review

Spatiotemporal human representation based on 3D visual perception data i...
research
11/30/2019

Collaborative SLAM based on Wifi Fingerprint Similarity and Motion Information

Simultaneous localization and mapping (SLAM) has been extensively resear...

Please sign up or login with your details

Forgot password? Click here to reset