DeepAI AI Chat
Log In Sign Up

Gait Recognition in the Wild with Dense 3D Representations and A Benchmark

by   Jinkai Zheng, et al., Inc.
Hangzhou Dianzi University

Existing studies for gait recognition are dominated by 2D representations like the silhouette or skeleton of the human body in constrained scenes. However, humans live and walk in the unconstrained 3D space, so projecting the 3D human body onto the 2D plane will discard a lot of crucial information like the viewpoint, shape, and dynamics for gait recognition. Therefore, this paper aims to explore dense 3D representations for gait recognition in the wild, which is a practical yet neglected problem. In particular, we propose a novel framework to explore the 3D Skinned Multi-Person Linear (SMPL) model of the human body for gait recognition, named SMPLGait. Our framework has two elaborately-designed branches of which one extracts appearance features from silhouettes, the other learns knowledge of 3D viewpoints and shapes from the 3D SMPL model. In addition, due to the lack of suitable datasets, we build the first large-scale 3D representation-based gait recognition dataset, named Gait3D. It contains 4,000 subjects and over 25,000 sequences extracted from 39 cameras in an unconstrained indoor scene. More importantly, it provides 3D SMPL models recovered from video frames which can provide dense 3D information of body shape, viewpoint, and dynamics. Based on Gait3D, we comprehensively compare our method with existing gait recognition approaches, which reflects the superior performance of our framework and the potential of 3D representations for gait recognition in the wild. The code and dataset are available at


page 3

page 11

page 12

page 13

page 14


Gait Recognition in the Wild: A Benchmark

Gait benchmarks empower the research community to train and evaluate hig...

Gait Recognition in the Wild with Multi-hop Temporal Switch

Existing studies for gait recognition are dominated by in-the-lab scenar...

OpenGait: Revisiting Gait Recognition Toward Better Practicality

Gait recognition is one of the most important long-distance identificati...

Gait Recognition Using 3-D Human Body Shape Inference

Gait recognition, which identifies individuals based on their walking pa...

VersatileGait: A Large-Scale Synthetic Gait Dataset Towards in-the-Wild Simulation

Gait recognition has a rapid development in recent years. However, gait ...

From Indoor To Outdoor: Unsupervised Domain Adaptive Gait Recognition

Gait recognition is an important AI task, which has been progressed rapi...

VersatileGait: A Large-Scale Synthetic Gait Dataset with Fine-GrainedAttributes and Complicated Scenarios

With the motivation of practical gait recognition applications, we propo...