What makes you, you? Analyzing Recognition by Swapping Face Parts

06/23/2022
by   Claudio Ferrari, et al.
10

Deep learning advanced face recognition to an unprecedented accuracy. However, understanding how local parts of the face affect the overall recognition performance is still mostly unclear. Among others, face swap has been experimented to this end, but just for the entire face. In this paper, we propose to swap facial parts as a way to disentangle the recognition relevance of different face parts, like eyes, nose and mouth. In our method, swapping parts from a source face to a target one is performed by fitting a 3D prior, which establishes dense pixels correspondence between parts, while also handling pose differences. Seamless cloning is then used to obtain smooth transitions between the mapped source regions and the shape and skin tone of the target face. We devised an experimental protocol that allowed us to draw some preliminary conclusions when the swapped images are classified by deep networks, indicating a prominence of the eyes and eyebrows region. Code available at https://github.com/clferrari/FacePartsSwap

READ FULL TEXT

page 1

page 3

page 4

page 5

page 6

research
05/03/2021

EQFace: A Simple Explicit Quality Network for Face Recognition

As the deep learning makes big progresses in still-image face recognitio...
research
09/19/2022

HiMFR: A Hybrid Masked Face Recognition Through Face Inpainting

To recognize the masked face, one of the possible solutions could be to ...
research
07/19/2021

Face.evoLVe: A High-Performance Face Recognition Library

In this paper, we develop face.evoLVe – a comprehensive library that col...
research
10/17/2022

Face Pasting Attack

Cujo AI and Adversa AI hosted the MLSec face recognition challenge. The ...
research
01/20/2015

Robust Face Recognition by Constrained Part-based Alignment

Developing a reliable and practical face recognition system is a long-st...
research
09/03/2023

Generalizability and Application of the Skin Reflectance Estimate Based on Dichromatic Separation (SREDS)

Face recognition (FR) systems have become widely used and readily availa...
research
06/27/2022

iExam: A Novel Online Exam Monitoring and Analysis System Based on Face Detection and Recognition

Online exams via video conference software like Zoom have been adopted i...

Please sign up or login with your details

Forgot password? Click here to reset