Face-to-Parameter Translation for Game Character Auto-Creation

09/03/2019
by   Tianyang Shi, et al.
10

Character customization system is an important component in Role-Playing Games (RPGs), where players are allowed to edit the facial appearance of their in-game characters with their own preferences rather than using default templates. This paper proposes a method for automatically creating in-game characters of players according to an input face photo. We formulate the above "artistic creation" process under a facial similarity measurement and parameter searching paradigm by solving an optimization problem over a large set of physically meaningful facial parameters. To effectively minimize the distance between the created face and the real one, two loss functions, i.e. a "discriminative loss" and a "facial content loss", are specifically designed. As the rendering process of a game engine is not differentiable, a generative network is further introduced as an "imitator" to imitate the physical behavior of the game engine so that the proposed method can be implemented under a neural style transfer framework and the parameters can be optimized by gradient descent. Experimental results demonstrate that our method achieves a high degree of generation similarity between the input face photo and the created in-game character in terms of both global appearance and local details. Our method has been deployed in a new game last year and has now been used by players over 1 million times.

READ FULL TEXT

page 4

page 6

page 7

page 8

page 12

page 13

page 14

page 15

research
08/17/2020

Fast and Robust Face-to-Parameter Translation for Game Character Auto-Creation

With the rapid development of Role-Playing Games (RPGs), players are now...
research
08/17/2020

Neutral Face Game Character Auto-Creation via PokerFace-GAN

Game character customization is one of the core features of many recent ...
research
03/02/2023

Zero-Shot Text-to-Parameter Translation for Game Character Auto-Creation

Recent popular Role-Playing Games (RPGs) saw the great success of charac...
research
01/05/2023

Character Simulation Using Imitation Learning With Game Engine Physics

Creating visual 3D sensing characters that interact with AI peers and vi...
research
03/05/2018

A Genetic Programming Framework for 2D Platform AI

There currently exists a wide range of techniques to model and evolve ar...
research
08/09/2023

VAST: Vivify Your Talking Avatar via Zero-Shot Expressive Facial Style Transfer

Current talking face generation methods mainly focus on speech-lip synch...

Please sign up or login with your details

Forgot password? Click here to reset