Disentangling Style and Content in Anime Illustrations

05/26/2019
by   Sitao Xiang, et al.
8

Existing methods for AI-generated artworks still struggle with generating high-quality stylized content, where high-level semantics are preserved, or separating fine-grained styles from various artists. We propose a novel Generative Adversarial Disentanglement Network which can fully decompose complex anime illustrations into style and content. Training such model is challenging, since given a style, various content data may exist but not the other way round. In particular, we disentangle two complementary factors of variations, where one of the factors is labelled. Our approach is divided into two stages, one that encodes an input image into a style independent content, and one based on a dual-conditional generator. We demonstrate the ability to generate high-fidelity anime portraits with a fixed content and a large variety of styles from over a thousand artists, and vice versa, using a single end-to-end network and with applications in style transfer. We show this unique capability as well as superior output to the current state-of-the-art.

READ FULL TEXT

page 6

page 8

page 13

page 15

page 16

research
04/24/2020

ST^2: Small-data Text Style Transfer via Multi-task Meta-Learning

Text style transfer aims to paraphrase a sentence in one style into anot...
research
08/12/2021

MISS GAN: A Multi-IlluStrator Style Generative Adversarial Network for image to illustration translation

Unsupervised style transfer that supports diverse input styles using onl...
research
02/21/2021

Rethinking Content and Style: Exploring Bias for Unsupervised Disentanglement

Content and style (C-S) disentanglement intends to decompose the underly...
research
05/25/2018

Beyond Textures: Learning from Multi-domain Artistic Images for Arbitrary Style Transfer

We propose a fast feed-forward network for arbitrary style transfer, whi...
research
12/01/2017

Multi-Content GAN for Few-Shot Font Style Transfer

In this work, we focus on the challenge of taking partial observations o...
research
10/02/2019

A Deep Factorization of Style and Structure in Fonts

We propose a deep factorization model for typographic analysis that dise...
research
07/27/2023

PromptStyler: Prompt-driven Style Generation for Source-free Domain Generalization

In a joint vision-language space, a text feature (e.g., from "a photo of...

Please sign up or login with your details

Forgot password? Click here to reset