DeepAI AI Chat
Log In Sign Up

End2End Occluded Face Recognition by Masking Corrupted Features

by   Haibo Qiu, et al.

With the recent advancement of deep convolutional neural networks, significant progress has been made in general face recognition. However, the state-of-the-art general face recognition models do not generalize well to occluded face images, which are exactly the common cases in real-world scenarios. The potential reasons are the absences of large-scale occluded face data for training and specific designs for tackling corrupted features brought by occlusions. This paper presents a novel face recognition method that is robust to occlusions based on a single end-to-end deep neural network. Our approach, named FROM (Face Recognition with Occlusion Masks), learns to discover the corrupted features from the deep convolutional neural networks, and clean them by the dynamically learned masks. In addition, we construct massive occluded face images to train FROM effectively and efficiently. FROM is simple yet powerful compared to the existing methods that either rely on external detectors to discover the occlusions or employ shallow models which are less discriminative. Experimental results on the LFW, Megaface challenge 1, RMF2, AR dataset and other simulated occluded/masked datasets confirm that FROM dramatically improves the accuracy under occlusions, and generalizes well on general face recognition.


page 1

page 5

page 6

page 7

page 10

page 11

page 14


Occlusion Robust Face Recognition Based on Mask Learning with PairwiseDifferential Siamese Network

Deep Convolutional Neural Networks (CNNs) have been pushing the frontier...

A survey of face recognition techniques under occlusion

The limited capacity to recognize faces under occlusions is a long-stand...

OCFR 2022: Competition on Occluded Face Recognition From Synthetically Generated Structure-Aware Occlusions

This work summarizes the IJCB Occluded Face Recognition Competition 2022...

Face De-occlusion using 3D Morphable Model and Generative Adversarial Network

In recent decades, 3D morphable model (3DMM) has been commonly used in i...

Enhancing Convolutional Neural Networks for Face Recognition with Occlusion Maps and Batch Triplet Loss

Despite the recent success of convolutional neural networks for computer...

Multi-Agent Semi-Siamese Training for Long-tail and Shallow Face Learning

With the recent development of deep convolutional neural networks and la...

Deep Feature Augmentation for Occluded Image Classification

Due to the difficulty in acquiring massive task-specific occluded images...