Log In Sign Up

A Multi-task Joint Framework for Real-time Person Search

by   Ye Li, et al.

Person search generally involves three important parts: person detection, feature extraction and identity comparison. However, person search integrating detection, extraction and comparison has the following drawbacks. Firstly, the accuracy of detection will affect the accuracy of comparison. Secondly, it is difficult to achieve real-time in real-world applications. To solve these problems, we propose a Multi-task Joint Framework for real-time person search (MJF), which optimizes the person detection, feature extraction and identity comparison respectively. For the person detection module, we proposed the YOLOv5-GS model, which is trained with person dataset. It combines the advantages of the Ghostnet and the Squeeze-and-Excitation (SE) block, and improves the speed and accuracy. For the feature extraction module, we design the Model Adaptation Architecture (MAA), which could select different network according to the number of people. It could balance the relationship between accuracy and speed. For identity comparison, we propose a Three Dimension (3D) Pooled Table and a matching strategy to improve identification accuracy. On the condition of 1920*1080 resolution video and 500 IDs table, the identification rate (IR) and frames per second (FPS) achieved by our method could reach 93.6 and 25.7,


page 3

page 8


End-to-end Person Search Sequentially Trained on Aggregated Dataset

In video surveillance applications, person search is a challenging task ...

Quantifying Human Behavior on the Block Design Test Through Automated Multi-Level Analysis of Overhead Video

The block design test is a standardized, widely used neuropsychological ...

Person Search via A Mask-Guided Two-Stream CNN Model

In this work, we tackle the problem of person search, which is a challen...

Person re-identification based on Res2Net network

Person re-identification (re-ID) has been gaining in popularity in the r...

Online Multi-modal Person Search in Videos

The task of searching certain people in videos has seen increasing poten...

Resolution-invariant Person Re-Identification

Exploiting resolution invariant representation is critical for person Re...

A Spatio-Temporal Identity Verification Method for Person-Action Instance Search in Movies

As one of the challenging problems in video search, Person-Action Instan...