Permutation-invariant Feature Restructuring for Correlation-aware Image Set-based Recognition

08/03/2019
by   Xiaofeng Liu, et al.
1

We consider the problem of comparing the similarity of image sets with variable-quantity, quality and un-ordered heterogeneous images. We use feature restructuring to exploit the correlations of both inner&inter-set images. Specifically, the residual self-attention can effectively restructure the features using the other features within a set to emphasize the discriminative images and eliminate the redundancy. Then, a sparse/collaborative learning-based dependency-guided representation scheme reconstructs the probe features conditional to the gallery features in order to adaptively align the two sets. This enables our framework to be compatible with both verification and open-set identification. We show that the parametric self-attention network and non-parametric dictionary learning can be trained end-to-end by a unified alternative optimization scheme, and that the full framework is permutation-invariant. In the numerical experiments we conducted, our method achieves top performance on competitive image set/video-based face recognition and person re-identification benchmarks.

READ FULL TEXT

page 1

page 2

page 3

research
07/16/2018

SCAN: Self-and-Collaborative Attention Network for Video Person Re-identification

Video person re-identification attracts much attention in recent years. ...
research
07/07/2020

SaADB: A Self-attention Guided ADB Network for Person Re-identification

Recently, Batch DropBlock network (BDB) has demonstrated its effectivene...
research
07/05/2019

Dependency-aware Attention Control for Unconstrained Face Recognition with Image Sets

This paper targets the problem of image set-based face verification and ...
research
08/10/2020

MHSA-Net: Multi-Head Self-Attention Network for Occluded Person Re-Identification

This paper presents a novel person re-identification model, named Multi-...
research
03/23/2022

Spatial self-attention network with self-attention distillation for fine-grained image recognition

The underlining task for fine-grained image recognition captures both th...
research
08/05/2019

Attention Control with Metric Learning Alignment for Image Set-based Recognition

This paper considers the problem of image set-based face verification an...
research
08/27/2023

FaceCoresetNet: Differentiable Coresets for Face Set Recognition

In set-based face recognition, we aim to compute the most discriminative...

Please sign up or login with your details

Forgot password? Click here to reset