Deep Co-attention based Comparators For Relative Representation Learning in Person Re-identification

04/30/2018
by   Lin Wu, et al.
0

Person re-identification (re-ID) requires rapid, flexible yet discriminant representations to quickly generalize to unseen observations on-the-fly and recognize the same identity across disjoint camera views. Recent effective methods are developed in a pair-wise similarity learning system to detect a fixed set of features from distinct regions which are mapped to their vector embeddings for the distance measuring. However, the most relevant and crucial parts of each image are detected independently without referring to the dependency conditioned on one and another. Also, these region based methods rely on spatial manipulation to position the local features in comparable similarity measuring. To combat these limitations, in this paper we introduce the Deep Co-attention based Comparators (DCCs) that fuse the co-dependent representations of the paired images so as to focus on the relevant parts of both images and produce their relative representations. Given a pair of pedestrian images to be compared, the proposed model mimics the foveation of human eyes to detect distinct regions concurrent on both images, namely co-dependent features, and alternatively attend to relevant regions to fuse them into the similarity learning. Our comparator is capable of producing dynamic representations relative to a particular sample every time, and thus well-suited to the case of re-identifying pedestrians on-the-fly. We perform extensive experiments to provide the insights and demonstrate the effectiveness of the proposed DCCs in person re-ID. Moreover, our approach has achieved the state-of-the-art performance on three benchmark data sets: DukeMTMC-reID DukeMTMC, CUHK03 FPNN, and Market-1501 Market1501.

READ FULL TEXT

page 6

page 7

research
08/03/2018

Where-and-When to Look: Deep Siamese Attention Networks for Video-based Person Re-identification

Video-based person re-identification (re-id) is a central application in...
research
06/14/2016

End-to-End Comparative Attention Networks for Person Re-identification

Person re-identification across disjoint camera views has been widely ap...
research
07/21/2017

What-and-Where to Match: Deep Spatially Multiplicative Integration Networks for Person Re-identification

Matching pedestrians across disjoint camera views, known as person re-id...
research
01/04/2018

Crossing Generative Adversarial Networks for Cross-View Person Re-identification

Person re-identification (re-id) refers to matching pedestrians across d...
research
05/05/2017

Part-based Deep Hashing for Large-scale Person Re-identification

Large-scale is a trend in person re-identification (re-id). It is import...
research
09/13/2021

Global-Local Dynamic Feature Alignment Network for Person Re-Identification

The misalignment of human images caused by pedestrian detection bounding...
research
03/09/2021

Instance and Pair-Aware Dynamic Networks for Re-Identification

Re-identification (ReID) is to identify the same instance across differe...

Please sign up or login with your details

Forgot password? Click here to reset