Quality Aware Network for Set to Set Recognition

04/11/2017
by   Yu Liu, et al.
0

This paper targets on the problem of set to set recognition, which learns the metric between two image sets. Images in each set belong to the same identity. Since images in a set can be complementary, they hopefully lead to higher accuracy in practical applications. However, the quality of each sample cannot be guaranteed, and samples with poor quality will hurt the metric. In this paper, the quality aware network (QAN) is proposed to confront this problem, where the quality of each sample can be automatically learned although such information is not explicitly provided in the training stage. The network has two branches, where the first branch extracts appearance feature embedding for each sample and the other branch predicts quality score for each sample. Features and quality scores of all samples in a set are then aggregated to generate the final feature embedding. We show that the two branches can be trained in an end-to-end manner given only the set-level identity annotation. Analysis on gradient spread of this mechanism indicates that the quality learned by the network is beneficial to set-to-set recognition and simplifies the distribution that the network needs to fit. Experiments on both face verification and person re-identification show advantages of the proposed QAN. The source code and network structure can be downloaded at https://github.com/sciencefans/Quality-Aware-Network.

READ FULL TEXT

page 1

page 5

research
11/17/2018

Batch Feature Erasing for Person Re-identification and Beyond

This paper presents a new training mechanism called Batch Feature Erasin...
research
08/04/2021

FPB: Feature Pyramid Branch for Person Re-Identification

High performance person Re-Identification (Re-ID) requires the model to ...
research
05/24/2019

ACNet: Attention Based Network to Exploit Complementary Features for RGBD Semantic Segmentation

Compared to RGB semantic segmentation, RGBD semantic segmentation can ac...
research
11/20/2019

ID-aware Quality for Set-based Person Re-identification

Set-based person re-identification (SReID) is a matching problem that ai...
research
05/21/2020

GroupFace: Learning Latent Groups and Constructing Group-based Representations for Face Recognition

In the field of face recognition, a model learns to distinguish millions...
research
08/27/2023

FaceCoresetNet: Differentiable Coresets for Face Set Recognition

In set-based face recognition, we aim to compute the most discriminative...

Please sign up or login with your details

Forgot password? Click here to reset