Multi-Granularity Graph Pooling for Video-based Person Re-Identification

09/23/2022
by   Honghu Pan, et al.
0

The video-based person re-identification (ReID) aims to identify the given pedestrian video sequence across multiple non-overlapping cameras. To aggregate the temporal and spatial features of the video samples, the graph neural networks (GNNs) are introduced. However, existing graph-based models, like STGCN, perform the mean/max pooling on node features to obtain the graph representation, which neglect the graph topology and node importance. In this paper, we propose the graph pooling network (GPNet) to learn the multi-granularity graph representation for the video retrieval, where the graph pooling layer is implemented to downsample the graph. We first construct a multi-granular graph, whose node features denote image embedding learned by backbone, and edges are established between the temporal and Euclidean neighborhood nodes. We then implement multiple graph convolutional layers to perform the neighborhood aggregation on the graphs. To downsample the graph, we propose a multi-head full attention graph pooling (MHFAPool) layer, which integrates the advantages of existing node clustering and node selection pooling methods. Specifically, MHFAPool takes the main eigenvector of full attention matrix as the aggregation coefficients to involve the global graph information in each pooled nodes. Extensive experiments demonstrate that our GPNet achieves the competitive results on four widely-used datasets, i.e., MARS, DukeMTMC-VideoReID, iLIDS-VID and PRID-2011.

READ FULL TEXT

page 6

page 17

research
09/23/2022

Pose-Aided Video-based Person Re-Identification via Recurrent Graph Convolutional Network

Existing methods for video-based person re-identification (ReID) mainly ...
research
03/27/2020

Multi-Granularity Reference-Aided Attentive Feature Aggregation for Video-based Person Re-identification

Video-based person re-identification (reID) aims at matching the same pe...
research
03/07/2023

MPool: Motif-Based Graph Pooling

Graph Neural networks (GNNs) have recently become a powerful technique f...
research
05/21/2022

Micro-video recommendation model based on graph neural network and attention mechanism

With the rapid development of Internet technology and the comprehensive ...
research
11/29/2020

LABNet: Local Graph Aggregation Network with Class Balanced Loss for Vehicle Re-Identification

Vehicle re-identification is an important computer vision task where the...
research
05/14/2019

Graph Attribute Aggregation Network with Progressive Margin Folding

Graph convolutional neural networks (GCNNs) have been attracting increas...
research
12/23/2021

Graph attentive feature aggregation for text-independent speaker verification

The objective of this paper is to combine multiple frame-level features ...

Please sign up or login with your details

Forgot password? Click here to reset