High-Fidelity and Arbitrary Face Editing

03/29/2021
by   Yue Gao, et al.
9

Cycle consistency is widely used for face editing. However, we observe that the generator tends to find a tricky way to hide information from the original image to satisfy the constraint of cycle consistency, making it impossible to maintain the rich details (e.g., wrinkles and moles) of non-editing areas. In this work, we propose a simple yet effective method named HifaFace to address the above-mentioned problem from two perspectives. First, we relieve the pressure of the generator to synthesize rich details by directly feeding the high-frequency information of the input image into the end of the generator. Second, we adopt an additional discriminator to encourage the generator to synthesize rich details. Specifically, we apply wavelet transformation to transform the image into multi-frequency domains, among which the high-frequency parts can be used to recover the rich details. We also notice that a fine-grained and wider-range control for the attribute is of great importance for face editing. To achieve this goal, we propose a novel attribute regression loss. Powered by the proposed framework, we achieve high-fidelity and arbitrary face editing, outperforming other state-of-the-art approaches.

READ FULL TEXT

page 1

page 2

page 4

page 5

page 7

page 9

page 11

page 12

07/15/2022

WaveGAN: Frequency-aware GAN for High-Fidelity Few-shot Image Generation

Existing few-shot image generation approaches typically employ fusion-ba...
07/20/2018

Editable Generative Adversarial Networks: Generating and Editing Faces Simultaneously

We propose a novel framework for simultaneously generating and manipulat...
09/18/2018

Attribute Enhanced Face Aging with Wavelet-based Generative Adversarial Networks

Since it is difficult to collect face images of the same subject over a ...
02/23/2021

FaceController: Controllable Attribute Editing for Face in the Wild

Face attribute editing aims to generate faces with one or multiple desir...
12/31/2019

FaceShifter: Towards High Fidelity And Occlusion Aware Face Swapping

In this work, we propose a novel two-stage framework, called FaceShifter...
12/02/2016

A Visual Representation for Editing Face Images

We propose a new approach for editing face images, which enables numerou...
12/15/2021

Detail-aware Deep Clothing Animations Infused with Multi-source Attributes

This paper presents a novel learning-based clothing deformation method t...

Code Repositories

HifaFace

[CVPR 2021] High-Fidelity and Arbitrary Face Editing


view repo