DeepAI
Log In Sign Up

Pixel Sampling for Style Preserving Face Pose Editing

06/14/2021
by   Xiangnan Yin, et al.
0

The existing auto-encoder based face pose editing methods primarily focus on modeling the identity preserving ability during pose synthesis, but are less able to preserve the image style properly, which refers to the color, brightness, saturation, etc. In this paper, we take advantage of the well-known frontal/profile optical illusion and present a novel two-stage approach to solve the aforementioned dilemma, where the task of face pose manipulation is cast into face inpainting. By selectively sampling pixels from the input face and slightly adjust their relative locations with the proposed “Pixel Attention Sampling" module, the face editing result faithfully keeps the identity information as well as the image style unchanged. By leveraging high-dimensional embedding at the inpainting stage, finer details are generated. Further, with the 3D facial landmarks as guidance, our method is able to manipulate face pose in three degrees of freedom, i.e., yaw, pitch, and roll, resulting in more flexible face pose editing than merely controlling the yaw angle as usually achieved by the current state-of-the-art. Both the qualitative and quantitative evaluations validate the superiority of the proposed approach.

READ FULL TEXT

page 2

page 6

page 8

12/22/2020

GuidedStyle: Attribute Knowledge Guided Style Manipulation for Semantic Face Editing

Although significant progress has been made in synthesizing high-quality...
07/23/2018

Identity Preserving Face Completion for Large Ocular Region Occlusion

We present a novel deep learning approach to synthesize complete face im...
03/02/2020

VAE/WGAN-Based Image Representation Learning For Pose-Preserving Seamless Identity Replacement In Facial Images

We present a novel variational generative adversarial network (VGAN) bas...
05/06/2019

FaceShapeGene: A Disentangled Shape Representation for Flexible Face Image Editing

Existing methods for face image manipulation generally focus on editing ...
02/13/2022

Diverse facial inpainting guided by exemplars

Facial image inpainting is a task of filling visually realistic and sema...
06/03/2020

Reference Guided Face Component Editing

Face portrait editing has achieved great progress in recent years. Howev...
02/20/2022

Non-Deterministic Face Mask Removal Based On 3D Priors

This paper presents a novel image inpainting framework for face mask rem...