Boosting Masked Face Recognition with Multi-Task ArcFace

by   David Montero, et al.

In this paper, we address the problem of face recognition with masks. Given the global health crisis caused by COVID-19, mouth and nose-covering masks have become an essential everyday-clothing-accessory. This sanitary measure has put the state-of-the-art face recognition models on the ropes since they have not been designed to work with masked faces. In addition, the need has arisen for applications capable of detecting whether the subjects are wearing masks to control the spread of the virus. To overcome these problems a full training pipeline is presented based on the ArcFace work, with several modifications for the backbone and the loss function. From the original face-recognition dataset, a masked version is generated using data augmentation, and both datasets are combined during the training process. The selected network, based on ResNet-50, is modified to also output the probability of mask usage without adding any computational cost. Furthermore, the ArcFace loss is combined with the mask-usage classification loss, resulting in a new function named Multi-Task ArcFace (MTArcFace). Experimental results show that the proposed approach highly boosts the original model accuracy when dealing with masked faces, while preserving almost the same accuracy on the original non-masked datasets. Furthermore, it achieves an average accuracy of 99.78 classification.


page 4

page 5


MLFW: A Database for Face Recognition on Masked Faces

As more and more people begin to wear masks due to current COVID-19 pand...

Unmasking Face Embeddings by Self-restrained Triplet Loss for Accurate Masked Face Recognition

Using the face as a biometric identity trait is motivated by the contact...

Mask-invariant Face Recognition through Template-level Knowledge Distillation

The emergence of the global COVID-19 pandemic poses new challenges for b...

Masked Face Recognition using ResNet-50

Over the last twenty years, there have seen several outbreaks of differe...

Mask Usage Recognition using Vision Transformer with Transfer Learning and Data Augmentation

The COVID-19 pandemic has disrupted various levels of society. The use o...

A realistic approach to generate masked faces applied on two novel masked face recognition data sets

The COVID-19 pandemic raises the problem of adapting face recognition sy...

How Does Gender Balance In Training Data Affect Face Recognition Accuracy?

Even though deep learning methods have greatly increased the overall acc...