High-Fidelity and Arbitrary Face Editing

03/29/2021
by   Yue Gao, et al.
9

Cycle consistency is widely used for face editing. However, we observe that the generator tends to find a tricky way to hide information from the original image to satisfy the constraint of cycle consistency, making it impossible to maintain the rich details (e.g., wrinkles and moles) of non-editing areas. In this work, we propose a simple yet effective method named HifaFace to address the above-mentioned problem from two perspectives. First, we relieve the pressure of the generator to synthesize rich details by directly feeding the high-frequency information of the input image into the end of the generator. Second, we adopt an additional discriminator to encourage the generator to synthesize rich details. Specifically, we apply wavelet transformation to transform the image into multi-frequency domains, among which the high-frequency parts can be used to recover the rich details. We also notice that a fine-grained and wider-range control for the attribute is of great importance for face editing. To achieve this goal, we propose a novel attribute regression loss. Powered by the proposed framework, we achieve high-fidelity and arbitrary face editing, outperforming other state-of-the-art approaches.

READ FULL TEXT

page 1

page 2

page 4

page 5

page 7

page 9

page 11

page 12

research
07/15/2022

WaveGAN: Frequency-aware GAN for High-Fidelity Few-shot Image Generation

Existing few-shot image generation approaches typically employ fusion-ba...
research
10/18/2022

WaGI : Wavelet-based GAN Inversion for Preserving High-frequency Image Details

Recent GAN inversion models focus on preserving image-specific details t...
research
03/24/2023

TEGLO: High Fidelity Canonical Texture Mapping from Single-View Images

Recent work in Neural Fields (NFs) learn 3D representations from class-s...
research
07/15/2023

Both Spatial and Frequency Cues Contribute to High-Fidelity Image Inpainting

Deep generative approaches have obtained great success in image inpainti...
research
02/23/2021

FaceController: Controllable Attribute Editing for Face in the Wild

Face attribute editing aims to generate faces with one or multiple desir...
research
07/08/2023

High Fidelity 3D Hand Shape Reconstruction via Scalable Graph Frequency Decomposition

Despite the impressive performance obtained by recent single-image hand ...
research
08/21/2023

FocalDreamer: Text-driven 3D Editing via Focal-fusion Assembly

While text-3D editing has made significant strides in leveraging score d...

Please sign up or login with your details

Forgot password? Click here to reset