DeepAI AI Chat
Log In Sign Up

Gait Recognition in the Wild with Dense 3D Representations and A Benchmark

04/06/2022
by   Jinkai Zheng, et al.
JD.com, Inc.
Hangzhou Dianzi University
0

Existing studies for gait recognition are dominated by 2D representations like the silhouette or skeleton of the human body in constrained scenes. However, humans live and walk in the unconstrained 3D space, so projecting the 3D human body onto the 2D plane will discard a lot of crucial information like the viewpoint, shape, and dynamics for gait recognition. Therefore, this paper aims to explore dense 3D representations for gait recognition in the wild, which is a practical yet neglected problem. In particular, we propose a novel framework to explore the 3D Skinned Multi-Person Linear (SMPL) model of the human body for gait recognition, named SMPLGait. Our framework has two elaborately-designed branches of which one extracts appearance features from silhouettes, the other learns knowledge of 3D viewpoints and shapes from the 3D SMPL model. In addition, due to the lack of suitable datasets, we build the first large-scale 3D representation-based gait recognition dataset, named Gait3D. It contains 4,000 subjects and over 25,000 sequences extracted from 39 cameras in an unconstrained indoor scene. More importantly, it provides 3D SMPL models recovered from video frames which can provide dense 3D information of body shape, viewpoint, and dynamics. Based on Gait3D, we comprehensively compare our method with existing gait recognition approaches, which reflects the superior performance of our framework and the potential of 3D representations for gait recognition in the wild. The code and dataset are available at https://gait3d.github.io.

READ FULL TEXT

page 3

page 11

page 12

page 13

page 14

05/05/2022

Gait Recognition in the Wild: A Benchmark

Gait benchmarks empower the research community to train and evaluate hig...
09/01/2022

Gait Recognition in the Wild with Multi-hop Temporal Switch

Existing studies for gait recognition are dominated by in-the-lab scenar...
11/12/2022

OpenGait: Revisiting Gait Recognition Toward Better Practicality

Gait recognition is one of the most important long-distance identificati...
12/18/2022

Gait Recognition Using 3-D Human Body Shape Inference

Gait recognition, which identifies individuals based on their walking pa...
05/30/2021

VersatileGait: A Large-Scale Synthetic Gait Dataset Towards in-the-Wild Simulation

Gait recognition has a rapid development in recent years. However, gait ...
11/21/2022

From Indoor To Outdoor: Unsupervised Domain Adaptive Gait Recognition

Gait recognition is an important AI task, which has been progressed rapi...
01/05/2021

VersatileGait: A Large-Scale Synthetic Gait Dataset with Fine-GrainedAttributes and Complicated Scenarios

With the motivation of practical gait recognition applications, we propo...