SeamlessGAN: Self-Supervised Synthesis of Tileable Texture Maps

01/13/2022
by   Carlos Rodríguez - Pardo, et al.
19

We present SeamlessGAN, a method capable of automatically generating tileable texture maps from a single input exemplar. In contrast to most existing methods, focused solely on solving the synthesis problem, our work tackles both problems, synthesis and tileability, simultaneously. Our key idea is to realize that tiling a latent space within a generative network trained using adversarial expansion techniques produces outputs with continuity at the seam intersection that can be then be turned into tileable images by cropping the central area. Since not every value of the latent space is valid to produce high-quality outputs, we leverage the discriminator as a perceptual error metric capable of identifying artifact-free textures during a sampling process. Further, in contrast to previous work on deep texture synthesis, our model is designed and optimized to work with multi-layered texture representations, enabling textures composed of multiple maps such as albedo, normals, etc. We extensively test our design choices for the network architecture, loss function and sampling parameters. We show qualitatively and quantitatively that our approach outperforms previous methods and works for textures of different types.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 1

page 4

page 5

page 6

page 7

page 8

page 9

page 10

03/24/2017

Perception Driven Texture Generation

This paper investigates a novel task of generating texture images from p...
07/14/2020

Transposer: Universal Texture Synthesis Using Feature Maps as Transposed Convolution Filter

Conventional CNNs for texture synthesis consist of a sequence of (de)-co...
06/29/2020

GramGAN: Deep 3D Texture Synthesis From 2D Exemplars

We present a novel texture synthesis framework, enabling the generation ...
11/18/2019

Learning to Synthesize Fashion Textures

Existing unconditional generative models mainly focus on modeling genera...
11/13/2015

Procedural wood textures

Existing bidirectional reflectance distribution function (BRDF) models a...
01/13/2020

On Demand Solid Texture Synthesis Using Deep 3D Networks

This paper describes a novel approach for on demand volumetric texture s...
11/10/2020

Conceptual Compression via Deep Structure and Texture Synthesis

Existing compression methods typically focus on the removal of signal-le...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.