HyperColor: A HyperNetwork Approach for Synthesizing Auto-colored 3D Models for Game Scenes Population

08/03/2021
by   Ivan Kostiuk, et al.
7

Designing a 3D game scene is a tedious task that often requires a substantial amount of work. Typically, this task involves synthesis, coloring, and placement of 3D models within the game scene. To lessen this workload, we can apply machine learning to automate some aspects of the game scene development. Earlier research has already tackled automated generation of the game scene background with machine learning. However, model auto-coloring remains an underexplored problem. The automatic coloring of a 3D model is a challenging task, especially when dealing with the digital representation of a colorful, multipart object. In such a case, we have to “understand” the object's composition and coloring scheme of each part. Existing single-stage methods have their own caveats such as the need for segmentation of the object or generating individual parts that have to be assembled together to yield the final model. We address these limitations by proposing a two-stage training approach to synthesize auto-colored 3D models. In the first stage, we obtain a 3D point cloud representing a 3D object, whilst in the second stage, we assign colors to points within such cloud. Next, by leveraging the so-called triangulation trick, we generate a 3D mesh in which the surfaces are colored based on interpolation of colored points representing vertices of a given mesh triangle. This approach allows us to generate a smooth coloring scheme. Experimental evaluation shows that our two-stage approach gives better results in terms of shape reconstruction and coloring when compared to traditional single-stage techniques.

READ FULL TEXT

page 2

page 3

page 4

page 5

page 7

page 8

research
11/23/2019

Hardness of some variants of the graph coloring game

Very recently, a long-standing open question proposed by Bodlaender in 1...
research
07/29/2019

A Connected Version of the Graph Coloring Game

The graph coloring game is a two-player game in which, given a graph G a...
research
03/31/2022

Point Scene Understanding via Disentangled Instance Mesh Reconstruction

Semantic scene reconstruction from point cloud is an essential and chall...
research
06/11/2018

Coloring Delaunay-Edges and their Generalizations

We consider geometric graphs whose vertex set is a finite set of points ...
research
09/13/2021

A deep learning guided memetic framework for graph coloring problems

Given an undirected graph G=(V,E) with a set of vertices V and a set of ...
research
11/15/2017

Coloring intersection hypergraphs of pseudo-disks

We prove that the intersection hypergraph of a family of n pseudo-disks ...

Please sign up or login with your details

Forgot password? Click here to reset