Delving into High-Quality Synthetic Face Occlusion Segmentation Datasets

05/12/2022
by   Kenny T. R. Voo, et al.
5

This paper performs comprehensive analysis on datasets for occlusion-aware face segmentation, a task that is crucial for many downstream applications. The collection and annotation of such datasets are time-consuming and labor-intensive. Although some efforts have been made in synthetic data generation, the naturalistic aspect of data remains less explored. In our study, we propose two occlusion generation techniques, Naturalistic Occlusion Generation (NatOcc), for producing high-quality naturalistic synthetic occluded faces; and Random Occlusion Generation (RandOcc), a more general synthetic occluded data generation method. We empirically show the effectiveness and robustness of both methods, even for unseen occlusions. To facilitate model evaluation, we present two high-resolution real-world occluded face datasets with fine-grained annotations, RealOcc and RealOcc-Wild, featuring both careful alignment preprocessing and an in-the-wild setting for robustness test. We further conduct a comprehensive analysis on a newly introduced segmentation benchmark, offering insights for future exploration.

READ FULL TEXT

page 12

page 13

page 14

page 15

page 16

page 17

page 18

page 19

research
09/08/2021

On Recognizing Occluded Faces in the Wild

Facial appearance variations due to occlusion has been one of the main c...
research
09/15/2017

Masquer Hunter: Adversarial Occlusion-aware Face Detection

Occluded face detection is a challenging detection task due to the large...
research
11/24/2022

On Pitfalls of Measuring Occlusion Robustness through Data Distortion

Over the past years, the crucial role of data has largely been shadowed ...
research
01/20/2022

FaceOcc: A Diverse, High-quality Face Occlusion Dataset for Human Face Extraction

Occlusions often occur in face images in the wild, troubling face-relate...
research
12/18/2022

Mask-FPAN: Semi-Supervised Face Parsing in the Wild With De-Occlusion and UV GAN

Fine-grained semantic segmentation of a person's face and head, includin...
research
06/17/2021

To fit or not to fit: Model-based Face Reconstruction and Occlusion Segmentation from Weak Supervision

3D face reconstruction from a single image is challenging due to its ill...
research
02/24/2018

Facial Expression Analysis under Partial Occlusion: A Survey

Automatic machine-based Facial Expression Analysis (FEA) has made substa...

Please sign up or login with your details

Forgot password? Click here to reset