GaitFi: Robust Device-Free Human Identification via WiFi and Vision Multimodal Learning

08/30/2022
by   Lang Deng, et al.
4

As an important biomarker for human identification, human gait can be collected at a distance by passive sensors without subject cooperation, which plays an essential role in crime prevention, security detection and other human identification applications. At present, most research works are based on cameras and computer vision techniques to perform gait recognition. However, vision-based methods are not reliable when confronting poor illuminations, leading to degrading performances. In this paper, we propose a novel multimodal gait recognition method, namely GaitFi, which leverages WiFi signals and videos for human identification. In GaitFi, Channel State Information (CSI) that reflects the multi-path propagation of WiFi is collected to capture human gaits, while videos are captured by cameras. To learn robust gait information, we propose a Lightweight Residual Convolution Network (LRCN) as the backbone network, and further propose the two-stream GaitFi by integrating WiFi and vision features for the gait retrieval task. The GaitFi is trained by the triplet loss and classification loss on different levels of features. Extensive experiments are conducted in the real world, which demonstrates that the GaitFi outperforms state-of-the-art gait recognition methods based on single WiFi or camera, achieving 94.2

READ FULL TEXT

page 1

page 3

page 4

page 7

research
10/31/2016

Robust Gait Recognition by Integrating Inertial and RGBD Sensors

Gait has been considered as a promising and unique biometric for person ...
research
03/24/2023

Multimodal Adaptive Fusion of Face and Gait Features using Keyless attention based Deep Neural Networks for Human Identification

Biometrics plays a significant role in vision-based surveillance applica...
research
04/30/2020

Vision-based techniques for gait recognition

Global security concerns have raised a proliferation of video surveillan...
research
08/19/2016

We Can "See" You via Wi-Fi - WiFi Action Recognition via Vision-based Methods

Recently, Wi-Fi has caught tremendous attention for its ubiquity, and, m...
research
02/06/2019

Deep CSI Learning for Gait Biometric Sensing and Recognition

Gait is a person's natural walking style and a complex biological proces...
research
02/11/2020

Vision-based Fight Detection from Surveillance Cameras

Vision-based action recognition is one of the most challenging research ...
research
12/07/2022

GaitVibe+: Enhancing Structural Vibration-based Footstep Localization Using Temporary Cameras for In-home Gait Analysis

In-home gait analysis is important for providing early diagnosis and ada...

Please sign up or login with your details

Forgot password? Click here to reset