NeAT: Neural Artistic Tracing for Beautiful Style Transfer

04/11/2023
by   Dan Ruta, et al.
0

Style transfer is the task of reproducing the semantic contents of a source image in the artistic style of a second target image. In this paper, we present NeAT, a new state-of-the art feed-forward style transfer method. We re-formulate feed-forward style transfer as image editing, rather than image generation, resulting in a model which improves over the state-of-the-art in both preserving the source content and matching the target style. An important component of our model's success is identifying and fixing "style halos", a commonly occurring artefact across many style transfer techniques. In addition to training and testing on standard datasets, we introduce the BBST-4M dataset, a new, large scale, high resolution dataset of 4M images. As a component of curating this data, we present a novel model able to classify if an image is stylistic. We use BBST-4M to improve and measure the generalization of NeAT across a huge variety of styles. Not only does NeAT offer state-of-the-art quality and generalization, it is designed and trained for fast inference at high resolution.

READ FULL TEXT

page 1

page 5

page 7

page 12

page 15

page 16

page 17

page 18

research
08/09/2020

Block Shuffle: A Method for High-resolution Fast Style Transfer with Limited Memory

Fast Style Transfer is a series of Neural Style Transfer algorithms that...
research
02/25/2020

Style Transfer for Light Field Photography

As light field images continue to increase in use and application, it be...
research
04/12/2021

Drafting and Revision: Laplacian Pyramid Network for Fast High-Quality Artistic Style Transfer

Artistic style transfer aims at migrating the style from an example imag...
research
03/20/2017

Multi-style Generative Network for Real-time Transfer

Despite the rapid progress in style transfer, existing approaches using ...
research
03/27/2023

Training-free Style Transfer Emerges from h-space in Diffusion models

Diffusion models (DMs) synthesize high-quality images in various domains...
research
11/23/2016

Controlling Perceptual Factors in Neural Style Transfer

Neural Style Transfer has shown very exciting results enabling new forms...

Please sign up or login with your details

Forgot password? Click here to reset