Homogeneous and Heterogeneous Relational Graph for Visible-infrared Person Re-identification

09/18/2021
by   Yujian Feng, et al.
9

Visible-infrared person re-identification (VI Re-ID) aims to match person images between the visible and infrared modalities. Existing VI Re-ID methods mainly focus on extracting homogeneous structural relationships from a single image, while ignoring the heterogeneous correlation between cross-modality images. The homogenous and heterogeneous structured relationships are crucial to learning effective identity representation and cross-modality matching. In this paper, we separately model the homogenous structural relationship by a modality-specific graph within individual modality and then mine the heterogeneous structural correlation in these two modality-specific graphs. First, the homogeneous structured graph (HOSG) mines one-vs.-rest relation between an arbitrary node (local feature) and all the rest nodes within a visible or infrared image to learn effective identity representation. Second, to find cross-modality identity-consistent correspondence, the heterogeneous graph alignment module (HGAM) further measures the relational edge strength by route search between two-modality local node features. Third, we propose the cross-modality cross-correlation (CMCC) loss to extract the modality invariance in heterogeneous global graph representation. CMCC computes the mutual information between modalities and expels semantic redundancy. Extensive experiments on SYSU-MM01 and RegDB datasets demonstrate that our method outperforms state-of-the-arts with a gain of 13.73% and 9.45% Rank1/mAP. The code is available at https://github.com/fegnyujian/Homogeneous-and-Heterogeneous-Relational-Graph.

READ FULL TEXT
research
09/12/2023

Modality Unifying Network for Visible-Infrared Person Re-Identification

Visible-infrared person re-identification (VI-ReID) is a challenging tas...
research
08/29/2023

Learning Cross-modality Information Bottleneck Representation for Heterogeneous Person Re-Identification

Visible-Infrared person re-identification (VI-ReID) is an important and ...
research
08/30/2023

Adaptive Multi-Modalities Fusion in Sequential Recommendation Systems

In sequential recommendation, multi-modal information (e.g., text or ima...
research
08/01/2022

Counterfactual Intervention Feature Transfer for Visible-Infrared Person Re-identification

Graph-based models have achieved great success in person re-identificati...
research
07/09/2023

Histopathology Whole Slide Image Analysis with Heterogeneous Graph Representation Learning

Graph-based methods have been extensively applied to whole-slide histopa...
research
01/21/2021

CM-NAS: Rethinking Cross-Modality Neural Architectures for Visible-Infrared Person Re-Identification

Visible-Infrared person re-identification (VI-ReID) aims at matching cro...
research
11/09/2021

MMD-ReID: A Simple but Effective Solution for Visible-Thermal Person ReID

Learning modality invariant features is central to the problem of Visibl...

Please sign up or login with your details

Forgot password? Click here to reset