Learning Rich Features for Gait Recognition by Integrating Skeletons and Silhouettes

10/26/2021
by   Yunjie Peng, et al.
0

Gait recognition captures gait patterns from the walking sequence of an individual for identification. Most existing gait recognition methods learn features from silhouettes or skeletons for the robustness to clothing, carrying, and other exterior factors. The combination of the two data modalities, however, is not fully exploited. This paper proposes a simple yet effective bimodal fusion (BiFusion) network, which mines the complementary clues of skeletons and silhouettes, to learn rich features for gait identification. Particularly, the inherent hierarchical semantics of body joints in a skeleton is leveraged to design a novel Multi-scale Gait Graph (MSGG) network for the feature extraction of skeletons. Extensive experiments on CASIA-B and OUMVLP demonstrate both the superiority of the proposed MSGG network in modeling skeletons and the effectiveness of the bimodal fusion for gait recognition. Under the most challenging condition of walking in different clothes on CASIA-B, our method achieves the rank-1 accuracy of 92.1

READ FULL TEXT

page 1

page 10

research
04/08/2022

Spatial Transformer Network on Skeleton-based Gait Recognition

Skeleton-based gait recognition models usually suffer from the robustnes...
research
08/25/2023

TriGait: Aligning and Fusing Skeleton and Silhouette Gait Data via a Tri-Branch Network

Gait recognition is a promising biometric technology for identification ...
research
09/26/2022

Spatiotemporal Multi-scale Bilateral Motion Network for Gait Recognition

The critical goal of gait recognition is to acquire the inter-frame walk...
research
10/11/2019

CHD:Consecutive Horizontal Dropout for Human Gait Feature Extraction

Despite gait recognition and person re-identification researches have ma...
research
07/07/2022

GaitTAKE: Gait Recognition by Temporal Attention and Keypoint-guided Embedding

Gait recognition, which refers to the recognition or identification of a...
research
01/23/2020

Scattering Features for Multimodal Gait Recognition

We consider the problem of identifying people on the basis of their walk...
research
03/19/2023

Unsupervised Gait Recognition with Selective Fusion

Previous gait recognition methods primarily trained on labeled datasets,...

Please sign up or login with your details

Forgot password? Click here to reset