Spatial-Temporal Correlation and Topology Learning for Person Re-Identification in Videos

04/15/2021
by   Jiawei Liu, et al.
0

Video-based person re-identification aims to match pedestrians from video sequences across non-overlapping camera views. The key factor for video person re-identification is to effectively exploit both spatial and temporal clues from video sequences. In this work, we propose a novel Spatial-Temporal Correlation and Topology Learning framework (CTL) to pursue discriminative and robust representation by modeling cross-scale spatial-temporal correlation. Specifically, CTL utilizes a CNN backbone and a key-points estimator to extract semantic local features from human body at multiple granularities as graph nodes. It explores a context-reinforced topology to construct multi-scale graphs by considering both global contextual information and physical connections of human body. Moreover, a 3D graph convolution and a cross-scale graph convolution are designed, which facilitate direct cross-spacetime and cross-scale information propagation for capturing hierarchical spatial-temporal dependencies and structural information. By jointly performing the two convolutions, CTL effectively mines comprehensive clues that are complementary with appearance information to enhance representational capacity. Extensive experiments on two video benchmarks have demonstrated the effectiveness of the proposed method and the state-of-the-art performance.

READ FULL TEXT

page 1

page 3

page 8

research
04/10/2020

Co-Saliency Spatio-Temporal Interaction Network for Person Re-Identification in Videos

Person re-identification aims at identifying a certain pedestrian across...
research
11/19/2018

Multi-scale 3D Convolution Network for Video Based Person Re-Identification

This paper proposes a two-stream convolution network to extract spatial ...
research
04/30/2021

Learning Multi-Granular Hypergraphs for Video-Based Person Re-Identification

Video-based person re-identification (re-ID) is an important research to...
research
10/27/2017

Single Iteration Conditional Based DSE Considering Spatial and Temporal Correlation

Active players are introducing significant challenges in electric distri...
research
10/20/2020

Identification of deep breath while moving forward based on multiple body regions and graph signal analysis

This paper presents an unobtrusive solution that can automatically ident...
research
03/07/2021

Watching You: Global-guided Reciprocal Learning for Video-based Person Re-identification

Video-based person re-identification (Re-ID) aims to automatically retri...
research
09/05/2019

Adaptive Graph Representation Learning for Video Person Re-identification

Recent years have witnessed a great development of deep learning based v...

Please sign up or login with your details

Forgot password? Click here to reset