DF^2AM: Dual-level Feature Fusion and Affinity Modeling for RGB-Infrared Cross-modality Person Re-identification

04/01/2021
by   Junhui Yin, et al.
0

RGB-infrared person re-identification is a challenging task due to the intra-class variations and cross-modality discrepancy. Existing works mainly focus on learning modality-shared global representations by aligning image styles or feature distributions across modalities, while local feature from body part and relationships between person images are largely neglected. In this paper, we propose a Dual-level (i.e., local and global) Feature Fusion (DF^2) module by learning attention for discriminative feature from local to global manner. In particular, the attention for a local feature is determined locally, i.e., applying a learned transformation function on itself. Meanwhile, to further mining the relationships between global features from person images, we propose an Affinities Modeling (AM) module to obtain the optimal intra- and inter-modality image matching. Specifically, AM employes intra-class compactness and inter-class separability in the sample similarities as supervised information to model the affinities between intra- and inter-modality samples. Experimental results show that our proposed method outperforms state-of-the-arts by large margins on two widely used cross-modality re-ID datasets SYSU-MM01 and RegDB, respectively.

READ FULL TEXT

page 1

page 2

page 3

page 4

10/22/2019

Hetero-Center Loss for Cross-Modality Person Re-Identification

Cross-modality person re-identification is a challenging problem which r...
07/03/2020

A Similarity Inference Metric for RGB-Infrared Cross-Modality Person Re-identification

RGB-Infrared (IR) cross-modality person re-identification (re-ID), which...
07/18/2020

Dynamic Dual-Attentive Aggregation Learning for Visible-Infrared Person Re-Identification

Visible-infrared person re-identification (VI-ReID) is a challenging cro...
04/06/2021

Neural Feature Search for RGB-Infrared Person Re-Identification

RGB-Infrared person re-identification (RGB-IR ReID) is a challenging cro...
01/11/2022

On Exploring Pose Estimation as an Auxiliary Learning Task for Visible-Infrared Person Re-identification

Visible-infrared person re-identification (VI-ReID) has been challenging...
06/15/2021

G^2DA: Geometry-Guided Dual-Alignment Learning for RGB-Infrared Person Re-Identification

RGB-Infrared (IR) person re-identification aims to retrieve person-of-in...
02/26/2021

A Universal Model for Cross Modality Mapping by Relational Reasoning

With the aim of matching a pair of instances from two different modaliti...