Fast Patch-based Style Transfer of Arbitrary Style

12/13/2016
by   Tian Qi Chen, et al.
0

Artistic style transfer is an image synthesis problem where the content of an image is reproduced with the style of another. Recent works show that a visually appealing style transfer can be achieved by using the hidden activations of a pretrained convolutional neural network. However, existing methods either apply (i) an optimization procedure that works for any style image but is very expensive, or (ii) an efficient feedforward network that only allows a limited number of trained styles. In this work we propose a simpler optimization objective based on local matching that combines the content structure and style textures in a single layer of the pretrained network. We show that our objective has desirable properties such as a simpler optimization landscape, intuitive parameter tuning, and consistent frame-by-frame performance on video. Furthermore, we use 80,000 natural images and 80,000 paintings to train an inverse network that approximates the result of the optimization. This results in a procedure for artistic style transfer that is efficient but also allows arbitrary content and style images.

READ FULL TEXT

page 1

page 4

page 5

page 6

page 8

research
09/27/2019

Style Transfer by Rigid Alignment in Neural Net Feature Space

Arbitrary style transfer is an important problem in computer vision that...
research
12/21/2022

Artistic Arbitrary Style Transfer

Arbitrary Style Transfer is a technique used to produce a new image from...
research
05/17/2019

Transport-Based Neural Style Transfer for Smoke Simulations

Artistically controlling fluids has always been a challenging task. Opti...
research
01/21/2020

P^2-GAN: Efficient Style Transfer Using Single Style Image

Style transfer is a useful image synthesis technique that can re-render ...
research
03/12/2021

In the light of feature distributions: moment matching for Neural Style Transfer

Style transfer aims to render the content of a given image in the graphi...
research
09/19/2023

Retinex-guided Channel-grouping based Patch Swap for Arbitrary Style Transfer

The basic principle of the patch-matching based style transfer is to sub...
research
07/09/2018

StyleBlit: Fast Example-Based Stylization with Local Guidance

We present StyleBlit---an efficient example-based style transfer algorit...

Please sign up or login with your details

Forgot password? Click here to reset