MSO: Multi-Feature Space Joint Optimization Network for RGB-Infrared Person Re-Identification

10/21/2021
by   Yajun Gao, et al.
0

The RGB-infrared cross-modality person re-identification (ReID) task aims to recognize the images of the same identity between the visible modality and the infrared modality. Existing methods mainly use a two-stream architecture to eliminate the discrepancy between the two modalities in the final common feature space, which ignore the single space of each modality in the shallow layers. To solve it, in this paper, we present a novel multi-feature space joint optimization (MSO) network, which can learn modality-sharable features in both the single-modality space and the common space. Firstly, based on the observation that edge information is modality-invariant, we propose an edge features enhancement module to enhance the modality-sharable features in each single-modality space. Specifically, we design a perceptual edge features (PEF) loss after the edge fusion strategy analysis. According to our knowledge, this is the first work that proposes explicit optimization in the single-modality feature space on cross-modality ReID task. Moreover, to increase the difference between cross-modality distance and class distance, we introduce a novel cross-modality contrastive-center (CMCC) loss into the modality-joint constraints in the common feature space. The PEF loss and CMCC loss jointly optimize the model in an end-to-end manner, which markedly improves the network's performance. Extensive experiments demonstrate that the proposed model significantly outperforms state-of-the-art methods on both the SYSU-MM01 and RegDB datasets.

READ FULL TEXT

page 2

page 3

page 4

page 7

research
10/22/2019

Hetero-Center Loss for Cross-Modality Person Re-Identification

Cross-modality person re-identification is a challenging problem which r...
research
02/28/2020

Cross-modality Person re-identification with Shared-Specific Feature Transfer

Cross-modality person re-identification (cm-ReID) is a challenging but k...
research
05/25/2023

Dynamic Enhancement Network for Partial Multi-modality Person Re-identification

Many existing multi-modality studies are based on the assumption of moda...
research
10/25/2019

Attend to the Difference: Cross-Modality Person Re-identification via Contrastive Correlation

The problem of cross-modality person re-identification has been receivin...
research
04/06/2021

Neural Feature Search for RGB-Infrared Person Re-Identification

RGB-Infrared person re-identification (RGB-IR ReID) is a challenging cro...
research
03/26/2021

Leaning Compact and Representative Features for Cross-Modality Person Re-Identification

This paper pays close attention to the cross-modality visible-infrared p...
research
10/13/2019

RGB-Infrared Cross-Modality Person Re-Identification via Joint Pixel and Feature Alignment

RGB-Infrared (IR) person re-identification is an important and challengi...

Please sign up or login with your details

Forgot password? Click here to reset