Neutral Face Game Character Auto-Creation via PokerFace-GAN

08/17/2020
by   Tianyang Shi, et al.
21

Game character customization is one of the core features of many recent Role-Playing Games (RPGs), where players can edit the appearance of their in-game characters with their preferences. This paper studies the problem of automatically creating in-game characters with a single photo. In recent literature on this topic, neural networks are introduced to make game engine differentiable and the self-supervised learning is used to predict facial customization parameters. However, in previous methods, the expression parameters and facial identity parameters are highly coupled with each other, making it difficult to model the intrinsic facial features of the character. Besides, the neural network based renderer used in previous methods is also difficult to be extended to multi-view rendering cases. In this paper, considering the above problems, we propose a novel method named "PokerFace-GAN" for neutral face game character auto-creation. We first build a differentiable character renderer which is more flexible than the previous methods in multi-view rendering cases. We then take advantage of the adversarial training to effectively disentangle the expression parameters from the identity parameters and thus generate player-preferred neutral face (expression-less) characters. Since all components of our method are differentiable, our method can be easily trained under a multi-task self-supervised learning paradigm. Experiment results show that our method can generate vivid neutral face game characters that are highly similar to the input photos. The effectiveness of our method is verified by comparison results and ablation studies.

READ FULL TEXT

page 1

page 3

page 4

page 5

page 6

page 8

page 12

page 13

08/17/2020

Fast and Robust Face-to-Parameter Translation for Game Character Auto-Creation

With the rapid development of Role-Playing Games (RPGs), players are now...
09/03/2019

Face-to-Parameter Translation for Game Character Auto-Creation

Character customization system is an important component in Role-Playing...
04/27/2022

DraftRec: Personalized Draft Recommendation for Winning in Multi-Player Online Battle Arena Games

This paper presents a personalized character recommendation system for M...
04/09/2019

MVF-Net: Multi-View 3D Face Morphable Model Regression

We address the problem of recovering the 3D geometry of a human face fro...
11/19/2019

Learning Stylized Character Expressions from Humans

We present DeepExpr, a novel expression transfer system from humans to m...
01/31/2018

From Benedict Cumberbatch to Sherlock Holmes: Character Identification in TV series without a Script

The goal of this paper is the automatic identification of characters in ...
07/04/2022

Game State Learning via Game Scene Augmentation

Having access to accurate game state information is of utmost importance...

Code Repositories

pt_mesh_renderer

A PyTorch implementation for the "Mesh Renderer"


view repo