GANosaic: Mosaic Creation with Generative Texture Manifolds

12/01/2017
by   Nikolay Jetchev, et al.
0

This paper presents a novel framework for generating texture mosaics with convolutional neural networks. Our method is called GANosaic and performs optimization in the latent noise space of a generative texture model, which allows the transformation of a content image into a mosaic exhibiting the visual properties of the underlying texture manifold. To represent that manifold, we use a state-of-the-art generative adversarial method for texture synthesis, which can learn expressive texture representations from data and produce mosaic images with very high resolution. This fully convolutional model generates smooth (without any visible borders) mosaic images which morph and blend different textures locally. In addition, we develop a new type of differentiable statistical regularization appropriate for optimization over the prior noise space of the PSGAN model.

READ FULL TEXT

page 2

page 4

page 7

page 8

page 9

page 11

research
05/18/2017

Learning Texture Manifolds with the Periodic Spatial GAN

This paper introduces a novel approach to texture synthesis based on gen...
research
04/09/2019

User-Controllable Multi-Texture Synthesis with Generative Adversarial Networks

We propose a novel multi-texture synthesis model based on generative adv...
research
11/24/2012

Texture Modeling with Convolutional Spike-and-Slab RBMs and Deep Extensions

We apply the spike-and-slab Restricted Boltzmann Machine (ssRBM) to text...
research
05/27/2015

Texture Synthesis Using Convolutional Neural Networks

Here we introduce a new model of natural textures based on the feature s...
research
02/18/2020

LocoGAN – Locally Convolutional GAN

In the paper we construct a fully convolutional GAN model: LocoGAN, whic...
research
11/26/2021

μNCA: Texture Generation with Ultra-Compact Neural Cellular Automata

We study the problem of example-based procedural texture synthesis using...
research
05/15/2021

Texture Generation with Neural Cellular Automata

Neural Cellular Automata (NCA) have shown a remarkable ability to learn ...

Please sign up or login with your details

Forgot password? Click here to reset