Fast and Robust Face-to-Parameter Translation for Game Character Auto-Creation

08/17/2020
by   Tianyang Shi, et al.
9

With the rapid development of Role-Playing Games (RPGs), players are now allowed to edit the facial appearance of their in-game characters with their preferences rather than using default templates. This paper proposes a game character auto-creation framework that generates in-game characters according to a player's input face photo. Different from the previous methods that are designed based on neural style transfer or monocular 3D face reconstruction, we re-formulate the character auto-creation process in a different point of view: by predicting a large set of physically meaningful facial parameters under a self-supervised learning paradigm. Instead of updating facial parameters iteratively at the input end of the renderer as suggested by previous methods, which are time-consuming, we introduce a facial parameter translator so that the creation can be done efficiently through a single forward propagation from the face embeddings to parameters, with a considerable 1000x computational speedup. Despite its high efficiency, the interactivity is preserved in our method where users are allowed to optionally fine-tune the facial parameters on our creation according to their needs. Our approach also shows better robustness than previous methods, especially for those photos with head-pose variance. Comparison results and ablation analysis on seven public face verification datasets suggest the effectiveness of our method.

READ FULL TEXT

page 1

page 3

page 4

page 7

page 10

page 11

page 12

09/03/2019

Face-to-Parameter Translation for Game Character Auto-Creation

Character customization system is an important component in Role-Playing...
08/17/2020

Neutral Face Game Character Auto-Creation via PokerFace-GAN

Game character customization is one of the core features of many recent ...
10/10/2021

Self-Supervised 3D Face Reconstruction via Conditional Estimation

We present a conditional estimation (CEST) framework to learn 3D facial ...
11/09/2018

Typeface Completion with Generative Adversarial Networks

The mood of a text and the intention of the writer can be reflected in t...
10/07/2020

A Human Ear Reconstruction Autoencoder

The ear, as an important part of the human head, has received much less ...
09/10/2021

Scalable Font Reconstruction with Dual Latent Manifolds

We propose a deep generative model that performs typography analysis and...