Arbitrary Style Transfer in Real-time with Adaptive Instance Normalization

03/20/2017
by   Xun Huang, et al.
0

Gatys et al. recently introduced a neural algorithm that renders a content image in the style of another image, achieving so-called style transfer. However, their framework requires a slow iterative optimization process, which limits its practical application. Fast approximations with feed-forward neural networks have been proposed to speed up neural style transfer. Unfortunately, the speed improvement comes at a cost: the network is usually tied to a fixed set of styles and cannot adapt to arbitrary new styles. In this paper, we present a simple yet effective approach that for the first time enables arbitrary style transfer in real-time. At the heart of our method is a novel adaptive instance normalization (AdaIN) layer that aligns the mean and variance of the content features with those of the style features. Our method achieves speed comparable to the fastest existing approach, without the restriction to a pre-defined set of styles. In addition, our approach allows flexible user controls such as content-style trade-off, style interpolation, color & spatial controls, all using a single feed-forward neural network.

READ FULL TEXT

page 6

page 7

page 8

page 9

research
12/13/2018

MetaStyle: Three-Way Trade-Off Among Speed, Flexibility, and Quality in Neural Style Transfer

An unprecedented booming has been witnessed in the research area of arti...
research
03/20/2017

Multi-style Generative Network for Real-time Transfer

Despite the rapid progress in style transfer, existing approaches using ...
research
10/06/2020

Arbitrary Style Transfer using Graph Instance Normalization

Style transfer is the image synthesis task, which applies a style of one...
research
05/18/2017

Exploring the structure of a real-time, arbitrary neural artistic stylization network

In this paper, we present a method which combines the flexibility of the...
research
04/23/2020

Joint Bilateral Learning for Real-time Universal Photorealistic Style Transfer

Photorealistic style transfer is the task of transferring the artistic s...
research
11/16/2019

Dynamic Instance Normalization for Arbitrary Style Transfer

Prior normalization methods rely on affine transformations to produce ar...
research
03/23/2023

Neural Preset for Color Style Transfer

In this paper, we present a Neural Preset technique to address the limit...

Please sign up or login with your details

Forgot password? Click here to reset