Temporal Attribute-Appearance Learning Network for Video-based Person Re-Identification

09/09/2020
by   Jiawei Liu, et al.
2

Video-based person re-identification aims to match a specific pedestrian in surveillance videos across different time and locations. Human attributes and appearance are complementary to each other, both of them contribute to pedestrian matching. In this work, we propose a novel Temporal Attribute-Appearance Learning Network (TALNet) for video-based person re-identification. TALNet simultaneously exploits human attributes and appearance to learn comprehensive and effective pedestrian representations from videos. It explores hard visual attention and temporal-semantic context for attributes, and spatial-temporal dependencies among body parts for appearance, to boost the learning of them. Specifically, an attribute branch network is proposed with a spatial attention block and a temporal-semantic context block for learning robust attribute representation. The spatial attention block focuses the network on corresponding regions within video frames related to each attribute, the temporal-semantic context block learns both the temporal context for each attribute across video frames and the semantic context among attributes in each video frame. The appearance branch network is designed to learn effective appearance representation from both whole body and body parts with spatial-temporal dependencies among them. TALNet leverages the complementation between attribute and appearance representations, and jointly optimizes them by multi-task learning fashion. Moreover, we annotate ID-level attributes for each pedestrian in the two commonly used video datasets. Extensive experiments on these datasets, have verified the superiority of TALNet over state-of-the-art methods.

READ FULL TEXT

page 1

page 4

page 5

page 11

research
11/19/2018

CA3Net: Contextual-Attentional Attribute-Appearance Network for Person Re-Identification

Person re-identification aims to identify the same pedestrian across non...
research
08/03/2018

Where-and-When to Look: Deep Siamese Attention Networks for Video-based Person Re-identification

Video-based person re-identification (re-id) is a central application in...
research
09/23/2022

Pose-Aided Video-based Person Re-Identification via Recurrent Graph Convolutional Network

Existing methods for video-based person re-identification (ReID) mainly ...
research
09/13/2021

Spatial and Semantic Consistency Regularizations for Pedestrian Attribute Recognition

While recent studies on pedestrian attribute recognition have shown rema...
research
10/17/2021

Robust Pedestrian Attribute Recognition Using Group Sparsity for Occlusion Videos

Occlusion processing is a key issue in pedestrian attribute recognition ...
research
11/29/2014

Pedestrian Detection aided by Deep Learning Semantic Tasks

Deep learning methods have achieved great success in pedestrian detectio...
research
07/27/2022

Portrait Interpretation and a Benchmark

We propose a task we name Portrait Interpretation and construct a datase...

Please sign up or login with your details

Forgot password? Click here to reset