SFI-Swin: Symmetric Face Inpainting with Swin Transformer by Distinctly Learning Face Components Distributions

01/09/2023
by   Mohammadreza Naderi, et al.
0

Image inpainting consists of filling holes or missing parts of an image. Inpainting face images with symmetric characteristics is more challenging than inpainting a natural scene. None of the powerful existing models can fill out the missing parts of an image while considering the symmetry and homogeneity of the picture. Moreover, the metrics that assess a repaired face image quality cannot measure the preservation of symmetry between the rebuilt and existing parts of a face. In this paper, we intend to solve the symmetry problem in the face inpainting task by using multiple discriminators that check each face organ's reality separately and a transformer-based network. We also propose "symmetry concentration score" as a new metric for measuring the symmetry of a repaired face image. The quantitative and qualitative results show the superiority of our proposed method compared to some of the recently proposed algorithms in terms of the reality, symmetry, and homogeneity of the inpainted parts.

READ FULL TEXT

page 5

page 7

page 8

page 9

page 10

page 11

research
11/12/2018

Hallucinating very low-resolution and obscured face images

Most of the face hallucination methods are often designed for complete i...
research
02/05/2020

Domain Embedded Multi-model Generative Adversarial Networks for Image-based Face Inpainting

Prior knowledge of face shape and location plays an important role in fa...
research
02/20/2022

Non-Deterministic Face Mask Removal Based On 3D Priors

This paper presents a novel image inpainting framework for face mask rem...
research
06/01/2021

PanoDR: Spherical Panorama Diminished Reality for Indoor Scenes

The rising availability of commercial 360^∘ cameras that democratize ind...
research
07/14/2019

Perceptually Motivated Method for Image Inpainting Comparison

The field of automatic image inpainting has progressed rapidly in recent...
research
11/16/2016

DeMeshNet: Blind Face Inpainting for Deep MeshFace Verification

MeshFace photos have been widely used in many Chinese business organizat...
research
09/22/2021

FaceEraser: Removing Facial Parts for Augmented Reality

Our task is to remove all facial parts (e.g., eyebrows, eyes, mouth and ...

Please sign up or login with your details

Forgot password? Click here to reset