One-Shot Face Reenactment on Megapixels

05/26/2022
by   Wonjun Kang, et al.
0

The goal of face reenactment is to transfer a target expression and head pose to a source face while preserving the source identity. With the popularity of face-related applications, there has been much research on this topic. However, the results of existing methods are still limited to low-resolution and lack photorealism. In this work, we present a one-shot and high-resolution face reenactment method called MegaFR. To be precise, we leverage StyleGAN by using 3DMM-based rendering images and overcome the lack of high-quality video datasets by designing a loss function that works without high-quality videos. Also, we apply iterative refinement to deal with extreme poses and/or expressions. Since the proposed method controls source images through 3DMM parameters, we can explicitly manipulate source images. We apply MegaFR to various applications such as face frontalization, eye in-painting, and talking head generation. Experimental results show that our method successfully disentangles identity from expression and head pose, and outperforms conventional methods.

READ FULL TEXT

page 21

page 22

page 23

page 25

page 26

page 27

page 28

page 29

research
05/13/2020

FaR-GAN for One-Shot Face Reenactment

Animating a static face image with target facial expressions and movemen...
research
03/30/2021

Head2HeadFS: Video-based Head Reenactment with Few-shot Learning

Over the past years, a substantial amount of work has been done on the p...
research
04/27/2023

Controllable One-Shot Face Video Synthesis With Semantic Aware Prior

The one-shot talking-head synthesis task aims to animate a source image ...
research
05/29/2018

Deep Video Portraits

We present a novel approach that enables photo-realistic re-animation of...
research
07/15/2022

MegaPortraits: One-shot Megapixel Neural Head Avatars

In this work, we advance the neural head avatar technology to the megapi...
research
05/26/2021

PSGAN++: Robust Detail-Preserving Makeup Transfer and Removal

In this paper, we address the makeup transfer and removal tasks simultan...
research
09/29/2021

Identity-Expression Ambiguity in 3D Morphable Face Models

3D Morphable Models are a class of generative models commonly used to mo...

Please sign up or login with your details

Forgot password? Click here to reset