FaceMAE: Privacy-Preserving Face Recognition via Masked Autoencoders

05/23/2022
by   Kai Wang, et al.
16

Face recognition, as one of the most successful applications in artificial intelligence, has been widely used in security, administration, advertising, and healthcare. However, the privacy issues of public face datasets have attracted increasing attention in recent years. Previous works simply mask most areas of faces or synthesize samples using generative models to construct privacy-preserving face datasets, which overlooks the trade-off between privacy protection and data utility. In this paper, we propose a novel framework FaceMAE, where the face privacy and recognition performance are considered simultaneously. Firstly, randomly masked face images are used to train the reconstruction module in FaceMAE. We tailor the instance relation matching (IRM) module to minimize the distribution gap between real faces and FaceMAE reconstructed ones. During the deployment phase, we use trained FaceMAE to reconstruct images from masked faces of unseen identities without extra training. The risk of privacy leakage is measured based on face retrieval between reconstructed and original datasets. Experiments prove that the identities of reconstructed images are difficult to be retrieved. We also perform sufficient privacy-preserving face recognition on several public face datasets (i.e. CASIA-WebFace and WebFace260M). Compared to previous state of the arts, FaceMAE consistently reduces at least 50% error rate on LFW, CFP-FP and AgeDB.

READ FULL TEXT
research
08/21/2023

Privacy-Preserving Face Recognition Using Random Frequency Components

The ubiquitous use of face recognition has sparked increasing privacy co...
research
10/15/2021

On Generating Identifiable Virtual Faces

Face anonymization with generative models have become increasingly preva...
research
07/30/2022

Towards Privacy-Preserving, Real-Time and Lossless Feature Matching

Most visual retrieval applications store feature vectors for downstream ...
research
06/09/2022

Reconstruct Face from Features Using GAN Generator as a Distribution Constraint

Face recognition based on the deep convolutional neural networks (CNN) s...
research
10/20/2020

"Healthy surveillance": Designing a concept for privacy-preserving mask recognition AI in the age of pandemics

The obligation to wear masks in times of pandemics reduces the risk of s...
research
10/29/2018

Concealing the identity of faces in oblique images with adaptive hopping Gaussian mixtures

Cameras mounted on Micro Aerial Vehicles (MAVs) are increasingly used fo...
research
05/13/2019

Robustness Analysis of Face Obscuration

Face obscuration is often needed by law enforcement or mass media outlet...

Please sign up or login with your details

Forgot password? Click here to reset