Attention Control with Metric Learning Alignment for Image Set-based Recognition

08/05/2019
by   Xiaofeng Liu, et al.
2

This paper considers the problem of image set-based face verification and identification. Unlike traditional single sample (an image or a video) setting, this situation assumes the availability of a set of heterogeneous collection of orderless images and videos. The samples can be taken at different check points, different identity documents etc. The importance of each image is usually considered either equal or based on a quality assessment of that image independent of other images and/or videos in that image set. How to model the relationship of orderless images within a set remains a challenge. We address this problem by formulating it as a Markov Decision Process (MDP) in a latent space. Specifically, we first propose a dependency-aware attention control (DAC) network, which uses actor-critic reinforcement learning for attention decision of each image to exploit the correlations among the unordered images. An off-policy experience replay is introduced to speed up the learning process. Moreover, the DAC is combined with a temporal model for videos using divide and conquer strategies. We also introduce a pose-guided representation (PGR) scheme that can further boost the performance at extreme poses. We propose a parameter-free PGR without the need for training as well as a novel metric learning-based PGR for pose alignment without the need for pose detection in testing stage. Extensive evaluations on IJB-A/B/C, YTF, Celebrity-1000 datasets demonstrate that our method outperforms many state-of-art approaches on the set-based as well as video-based face recognition databases.

READ FULL TEXT

page 1

page 2

page 7

research
07/05/2019

Dependency-aware Attention Control for Unconstrained Face Recognition with Image Sets

This paper targets the problem of image set-based face verification and ...
research
04/03/2013

Patch-based Probabilistic Image Quality Assessment for Face Selection and Improved Video-based Face Recognition

In video based face recognition, face images are typically captured over...
research
03/12/2016

Template Adaptation for Face Verification and Identification

Face recognition performance evaluation has traditionally focused on one...
research
02/10/2017

Reconstruction-Based Disentanglement for Pose-invariant Face Recognition

Deep neural networks (DNNs) trained on large-scale datasets have recentl...
research
08/03/2019

Permutation-invariant Feature Restructuring for Correlation-aware Image Set-based Recognition

We consider the problem of comparing the similarity of image sets with v...
research
01/25/2019

Face morphing detection in the presence of printing/scanning and heterogeneous image sources

Face morphing represents nowadays a big security threat in the context o...
research
03/25/2019

Dual Variational Generation for Low-Shot Heterogeneous Face Recognition

Heterogeneous Face Recognition (HFR) is a challenging issue because of t...

Please sign up or login with your details

Forgot password? Click here to reset