Bridging the Distribution Gap of Visible-Infrared Person Re-identification with Modality Batch Normalization

03/08/2021
by   Wenkang Li, et al.
5

Visible-infrared cross-modality person re-identification (VI-ReID), whose aim is to match person images between visible and infrared modality, is a challenging cross-modality image retrieval task. Most existing works integrate batch normalization layers into their neural network, but we found out that batch normalization layers would lead to two types of distribution gap: 1) inter-mini-batch distribution gap – the distribution gap of the same modality between each mini-batch; 2) intra-mini-batch modality distribution gap – the distribution gap of different modality within the same mini-batch. To address these problems, we propose a new batch normalization layer called Modality Batch Normalization (MBN), which normalizes each modality sub-mini-batch respectively instead of the whole mini-batch, and can reduce these distribution gap significantly. Extensive experiments show that our MBN is able to boost the performance of VI-ReID models, even with different datasets, backbones and losses.

READ FULL TEXT
research
03/08/2021

Unified Batch All Triplet Loss for Visible-Infrared Person Re-identification

Visible-Infrared cross-modality person re-identification (VI-ReID), whos...
research
07/17/2023

Bridging the Gap: Multi-Level Cross-Modality Joint Alignment for Visible-Infrared Person Re-Identification

Visible-Infrared person Re-IDentification (VI-ReID) is a challenging cro...
research
03/26/2023

MRCN: A Novel Modality Restitution and Compensation Network for Visible-Infrared Person Re-identification

Visible-infrared person re-identification (VI-ReID), which aims to searc...
research
01/21/2021

CM-NAS: Rethinking Cross-Modality Neural Architectures for Visible-Infrared Person Re-Identification

Visible-Infrared person re-identification (VI-ReID) aims at matching cro...
research
08/06/2020

Dual Gaussian-based Variational Subspace Disentanglement for Visible-Infrared Person Re-Identification

Visible-infrared person re-identification (VI-ReID) is a challenging and...
research
06/19/2019

A Strong Baseline and Batch Normalization Neck for Deep Person Re-identification

This study explores a simple but strong baseline for person re-identific...
research
08/01/2022

Counterfactual Intervention Feature Transfer for Visible-Infrared Person Re-identification

Graph-based models have achieved great success in person re-identificati...

Please sign up or login with your details

Forgot password? Click here to reset