An Efficient Framework for Visible-Infrared Cross Modality Person Re-Identification

07/15/2019
by   Emrah Basaran, et al.
9

Visible-infrared cross modality person re-identification (VI-ReId) is an important task for video surveillance in poorly illuminated or dark environments. Despite many recent studies on person re-identification in visible domain (ReId), there are few studies dealing with VI-ReId. Besides challenges that are common for both ReId and VI-ReId such as pose/illumination variations, background clutter and occlusion, VI-ReId has additional challenges as color information is not available in infrared images. As a result, the performance of VI-ReId systems is typically lower than ReId systems. In this work, we propose a 4-stream framework to improve VI-ReId performance. We train a separate deep convolutional neural network in each stream using different representations of input images. We expect that different and complementary features can be learned from each stream. In our framework, grayscale and infrared input images are used to train the ResNet in the first stream. In the second stream, RGB and 3-channel infrared images (created by repeating infrared channel) are used. In the remaining two streams, we use local pattern maps as input images. These maps are generated utilizing local Zernike moments transformation. Local pattern maps are obtained from grayscale and infrared images in the 3rd stream and from RGB and 3-channel infrared images in the last stream. We improve the performance of the proposed framework by employing a re-ranking algorithm for post processing. Our results indicate that the proposed framework outperforms current state-of-the-art on SYSU-MM01 dataset with large margin by improving Rank-1/mAP by 34.2 all-search and indoor-search modes, respectively.

READ FULL TEXT

page 5

page 8

research
02/29/2020

Cross-Spectrum Dual-Subspace Pairing for RGB-infrared Cross-Modality Person Re-Identification

Due to its potential wide applications in video surveillance and other c...
research
02/24/2021

SFANet: A Spectrum-aware Feature Augmentation Network for Visible-Infrared Person Re-Identification

Visible-Infrared person re-identification (VI-ReID) is a challenging mat...
research
06/07/2019

HPILN: A feature learning framework for cross-modality person re-identification

Most video surveillance systems use both RGB and infrared cameras, makin...
research
10/12/2020

Top-DB-Net: Top DropBlock for Activation Enhancement in Person Re-Identification

Person Re-Identification is a challenging task that aims to retrieve all...
research
06/24/2019

Cross-Channel Correlation Preserved Three-Stream Lightweight CNNs for Demosaicking

Demosaicking is a procedure to reconstruct full RGB images from Color Fi...
research
05/28/2019

Video-based Person Re-identification with Two-stream Convolutional Network and Co-attentive Snippet Embedding

Recently, the applications of person re-identification in visual surveil...

Please sign up or login with your details

Forgot password? Click here to reset