Few-shots Portrait Generation with Style Enhancement and Identity Preservation

03/01/2023
by   Runchuan Zhu, et al.
0

Nowadays, the wide application of virtual digital human promotes the comprehensive prosperity and development of digital culture supported by digital economy. The personalized portrait automatically generated by AI technology needs both the natural artistic style and human sentiment. In this paper, we propose a novel StyleIdentityGAN model, which can ensure the identity and artistry of the generated portrait at the same time. Specifically, the style-enhanced module focuses on artistic style features decoupling and transferring to improve the artistry of generated virtual face images. Meanwhile, the identity-enhanced module preserves the significant features extracted from the input photo. Furthermore, the proposed method requires a small number of reference style data. Experiments demonstrate the superiority of StyleIdentityGAN over state-of-art methods in artistry and identity effects, with comparisons done qualitatively, quantitatively and through a perceptual user study. Code has been released on Github3.

READ FULL TEXT

page 7

page 8

page 9

page 10

page 11

research
11/19/2022

Face Swapping as A Simple Arithmetic Operation

We propose a novel high-fidelity face swapping method called "Arithmetic...
research
12/30/2022

Imitator: Personalized Speech-driven 3D Facial Animation

Speech-driven 3D facial animation has been widely explored, with applica...
research
05/21/2023

iWarpGAN: Disentangling Identity and Style to Generate Synthetic Iris Images

Generative Adversarial Networks (GANs) have shown success in approximati...
research
03/02/2022

Styleverse: Towards Identity Stylization across Heterogeneous Domains

We propose a new challenging task namely IDentity Stylization (IDS) acro...
research
10/29/2019

Disentangling Timbre and Singing Style with Multi-singer Singing Synthesis System

In this study, we define the identity of the singer with two independent...
research
09/20/2020

DVG-Face: Dual Variational Generation for Heterogeneous Face Recognition

Heterogeneous Face Recognition (HFR) refers to matching cross-domain fac...
research
07/07/2023

Social learning across symbolic cultural barriers in non-human cultures

Social learning is key in the development of both human and non-human an...

Please sign up or login with your details

Forgot password? Click here to reset