Head and Body: Unified Detector and Graph Network for Person Search in Media

by   Xiujun Shu, et al.

Person search in media has seen increasing potential in Internet applications, such as video clipping and character collection. This task is common but overlooked by previous person search works which focus on surveillance scenes. The media scenarios have some different challenges from surveillance scenes. For example, a person may change his clothes frequently. To alleviate this issue, this paper proposes a Unified Detector and Graph Network (UDGNet) for person search in media. UDGNet is the first person search framework to detect and re-identify the human body and head simultaneously. Specifically, it first builds two branches based on a unified network to detect the human body and head, then the detected body and head are used for re-identification. This dual-task approach can significantly enhance discriminative learning. To tackle the cloth-changing issue, UDGNet builds two graphs to explore reliable links among cloth-changing samples and utilizes a graph network to learn better embeddings. This design effectively enhances the robustness of person search to cloth-changing challenges. Besides, we demonstrate that UDGNet can be implemented with both anchor-based and anchor-free person search frameworks and further achieve performance improvement. This paper also contributes a large-scale dataset for Person Search in Media (PSM), which provides both body and head annotations. It is by far the largest dataset for person search in media. Experiments show that UDGNet improves the anchor-free model AlignPS by 12.1 shows good generalization across surveillance and longterm scenarios. The dataset and code will be available at: https://github.com/shuxjweb/PSM.git.


page 1

page 3

page 4

page 8


Anchor-Free Person Search

Person search aims to simultaneously localize and identify a query perso...

Robust Partial Matching for Person Search in the Wild

Various factors like occlusions, backgrounds, etc., would lead to misali...

Efficient Person Search: An Anchor-Free Approach

Person search aims to simultaneously localize and identify a query perso...

Ground-to-Aerial Person Search: Benchmark Dataset and Approach

In this work, we construct a large-scale dataset for Ground-to-Aerial Pe...

FCHD: A fast and accurate head detector

In this paper, we propose FCHD-Fully Convolutional Head Detector, which ...

Global-Local Context Network for Person Search

Person search aims to jointly localize and identify a query person from ...

Gallery Filter Network for Person Search

In person search, we aim to localize a query person from one scene in ot...

Please sign up or login with your details

Forgot password? Click here to reset