Short Range Correlation Transformer for Occluded Person Re-Identification

01/04/2022
by   Yunbin Zhao, et al.
4

Occluded person re-identification is one of the challenging areas of computer vision, which faces problems such as inefficient feature representation and low recognition accuracy. Convolutional neural network pays more attention to the extraction of local features, therefore it is difficult to extract features of occluded pedestrians and the effect is not so satisfied. Recently, vision transformer is introduced into the field of re-identification and achieves the most advanced results by constructing the relationship of global features between patch sequences. However, the performance of vision transformer in extracting local features is inferior to that of convolutional neural network. Therefore, we design a partial feature transformer-based person re-identification framework named PFT. The proposed PFT utilizes three modules to enhance the efficiency of vision transformer. (1) Patch full dimension enhancement module. We design a learnable tensor with the same size as patch sequences, which is full-dimensional and deeply embedded in patch sequences to enrich the diversity of training samples. (2) Fusion and reconstruction module. We extract the less important part of obtained patch sequences, and fuse them with original patch sequence to reconstruct the original patch sequences. (3) Spatial Slicing Module. We slice and group patch sequences from spatial direction, which can effectively improve the short-range correlation of patch sequences. Experimental results over occluded and holistic re-identification datasets demonstrate that the proposed PFT network achieves superior performance consistently and outperforms the state-of-the-art methods.

READ FULL TEXT

page 2

page 3

page 4

research
03/17/2019

STNReID : Deep Convolutional Networks with Pairwise Spatial Transformer Networks for Partial Person Re-identification

Partial person re-identification (ReID) is a challenging task because on...
research
10/16/2018

SCPNet: Spatial-Channel Parallelism Network for Joint Holistic and Partial Person Re-Identification

Holistic person re-identification (ReID) has received extensive study in...
research
03/30/2021

Spatiotemporal Transformer for Video-based Person Re-identification

Recently, the Transformer module has been transplanted from natural lang...
research
09/23/2021

OH-Former: Omni-Relational High-Order Transformer for Person Re-Identification

Transformers have shown preferable performance on many vision tasks. How...
research
10/29/2022

ImplantFormer: Vision Transformer based Implant Position Regression Using Dental CBCT Data

Implant prosthesis is the most optimum treatment of dentition defect or ...
research
02/08/2021

TransReID: Transformer-based Object Re-Identification

In this paper, we explore the Vision Transformer (ViT), a pure transform...
research
12/14/2022

Dual-branch Cross-Patch Attention Learning for Group Affect Recognition

Group affect refers to the subjective emotion that is evoked by an exter...

Please sign up or login with your details

Forgot password? Click here to reset