Parsing is All You Need for Accurate Gait Recognition in the Wild

by   Jinkai Zheng, et al.

Binary silhouettes and keypoint-based skeletons have dominated human gait recognition studies for decades since they are easy to extract from video frames. Despite their success in gait recognition for in-the-lab environments, they usually fail in real-world scenarios due to their low information entropy for gait representations. To achieve accurate gait recognition in the wild, this paper presents a novel gait representation, named Gait Parsing Sequence (GPS). GPSs are sequences of fine-grained human segmentation, i.e., human parsing, extracted from video frames, so they have much higher information entropy to encode the shapes and dynamics of fine-grained human parts during walking. Moreover, to effectively explore the capability of the GPS representation, we propose a novel human parsing-based gait recognition framework, named ParsingGait. ParsingGait contains a Convolutional Neural Network (CNN)-based backbone and two light-weighted heads. The first head extracts global semantic features from GPSs, while the other one learns mutual information of part-level features through Graph Convolutional Networks to model the detailed dynamics of human walking. Furthermore, due to the lack of suitable datasets, we build the first parsing-based dataset for gait recognition in the wild, named Gait3D-Parsing, by extending the large-scale and challenging Gait3D dataset. Based on Gait3D-Parsing, we comprehensively evaluate our method and existing gait recognition methods. The experimental results show a significant improvement in accuracy brought by the GPS representation and the superiority of ParsingGait. The code and dataset are available at .


page 5

page 6

page 8

page 11

page 13

page 14

page 15

page 16


Gait Recognition in the Wild with Dense 3D Representations and A Benchmark

Existing studies for gait recognition are dominated by 2D representation...

Spatial Transformer Network on Skeleton-based Gait Recognition

Skeleton-based gait recognition models usually suffer from the robustnes...

VersatileGait: A Large-Scale Synthetic Gait Dataset with Fine-GrainedAttributes and Complicated Scenarios

With the motivation of practical gait recognition applications, we propo...

Gait Recognition in the Wild with Multi-hop Temporal Switch

Existing studies for gait recognition are dominated by in-the-lab scenar...

Exploring Deep Models for Practical Gait Recognition

Gait recognition is a rapidly advancing vision technique for person iden...

VersatileGait: A Large-Scale Synthetic Gait Dataset Towards in-the-Wild Simulation

Gait recognition has a rapid development in recent years. However, gait ...

Attention-based Walking Gait and Direction Recognition in Wi-Fi Networks

The study of human gait recognition has been becoming an active research...

Please sign up or login with your details

Forgot password? Click here to reset