Temporal Knowledge Propagation for Image-to-Video Person Re-identification

08/11/2019
by   Xinqian Gu, et al.
7

In many scenarios of Person Re-identification (Re-ID), the gallery set consists of lots of surveillance videos and the query is just an image, thus Re-ID has to be conducted between image and videos. Compared with videos, still person images lack temporal information. Besides, the information asymmetry between image and video features increases the difficulty in matching images and videos. To solve this problem, we propose a novel Temporal Knowledge Propagation (TKP) method which propagates the temporal knowledge learned by the video representation network to the image representation network. Specifically, given the input videos, we enforce the image representation network to fit the outputs of video representation network in a shared feature space. With back propagation, temporal knowledge can be transferred to enhance the image features and the information asymmetry problem can be alleviated. With additional classification and integrated triplet losses, our model can learn expressive and discriminative image and video features for image-to-video re-identification. Extensive experiments demonstrate the effectiveness of our method and the overall results on two widely used datasets surpass the state-of-the-art methods by a large margin.

READ FULL TEXT

page 1

page 7

research
12/24/2019

Ordered or Orderless: A Revisit for Video based Person Re-Identification

Is recurrent network really necessary for learning a good visual represe...
research
04/09/2019

Convolutional Temporal Attention Model for Video-based Person Re-identification

The goal of video-based person re-identification is to match two input v...
research
07/16/2020

Appearance-Preserving 3D Convolution for Video-based Person Re-identification

Due to the imperfect person detection results and posture changes, tempo...
research
07/27/2018

Person Search in Videos with One Portrait Through Visual and Temporal Links

In real-world applications, e.g. law enforcement and video retrieval, on...
research
08/23/2021

Exploring the Quality of GAN Generated Images for Person Re-Identification

Recently, GAN based method has demonstrated strong effectiveness in gene...
research
04/16/2019

What I See Is What You See: Joint Attention Learning for First and Third Person Video Co-analysis

In recent years, more and more videos are captured from the first-person...
research
12/16/2022

Feature Disentanglement Learning with Switching and Aggregation for Video-based Person Re-Identification

In video person re-identification (Re-ID), the network must consistently...

Please sign up or login with your details

Forgot password? Click here to reset