DeepAI AI Chat
Log In Sign Up

StyleBank: An Explicit Representation for Neural Image Style Transfer

03/27/2017
by   Dongdong Chen, et al.
Microsoft
USTC
0

We propose StyleBank, which is composed of multiple convolution filter banks and each filter bank explicitly represents one style, for neural image style transfer. To transfer an image to a specific style, the corresponding filter bank is operated on top of the intermediate feature embedding produced by a single auto-encoder. The StyleBank and the auto-encoder are jointly learnt, where the learning is conducted in such a way that the auto-encoder does not encode any style information thanks to the flexibility introduced by the explicit filter bank representation. It also enables us to conduct incremental learning to add a new image style by learning a new filter bank while holding the auto-encoder fixed. The explicit style representation along with the flexible network design enables us to fuse styles at not only the image level, but also the region level. Our method is the first style transfer network that links back to traditional texton mapping methods, and hence provides new understanding on neural style transfer. Our method is easy to train, runs in real-time, and produces results that qualitatively better or at least comparable to existing methods.

READ FULL TEXT

page 5

page 6

page 7

page 8

02/27/2019

StyleRemix: An Interpretable Representation for Neural Image Style Transfer

Multi-Style Transfer (MST) intents to capture the high-level visual voca...
06/13/2018

A Unified Framework for Generalizable Style Transfer: Style and Content Separation

Image style transfer has drawn broad attention in recent years. However,...
08/19/2021

Towards Controllable and Photorealistic Region-wise Image Manipulation

Adaptive and flexible image editing is a desirable function of modern ge...
06/03/2019

Massive Styles Transfer with Limited Labeled Data

Language style transfer has attracted more and more attention in the pas...
02/01/2021

GTAE: Graph-Transformer based Auto-Encoders for Linguistic-Constrained Text Style Transfer

Non-parallel text style transfer has attracted increasing research inter...
05/04/2022

Towards Robust and Semantically Organised Latent Representations for Unsupervised Text Style Transfer

Recent studies show that auto-encoder based approaches successfully perf...
10/14/2022

Controllable Style Transfer via Test-time Training of Implicit Neural Representation

We propose a controllable style transfer framework based on Implicit Neu...