Attention-aware Multi-stroke Style Transfer

01/16/2019
by   Yuan Yao, et al.
14

Neural style transfer has drawn considerable attention from both academic and industrial field. Although visual effect and efficiency have been significantly improved, existing methods are unable to coordinate spatial distribution of visual attention between the content image and stylized image, or render diverse level of detail via different brush strokes. In this paper, we tackle these limitations by developing an attention-aware multi-stroke style transfer model. We first propose to assemble self-attention mechanism into a style-agnostic reconstruction autoencoder framework, from which the attention map of a content image can be derived. By performing multi-scale style swap on content features and style features, we produce multiple feature maps reflecting different stroke patterns. A flexible fusion strategy is further presented to incorporate the salient characteristics from the attention map, which allows integrating multiple stroke patterns into different spatial regions of the output image harmoniously. We demonstrate the effectiveness of our method, as well as generate comparable stylized images with multiple stroke patterns against the state-of-the-art methods.

READ FULL TEXT

page 1

page 6

page 7

page 8

page 12

page 13

page 14

page 15

research
09/27/2019

Style Transfer by Rigid Alignment in Neural Net Feature Space

Arbitrary style transfer is an important problem in computer vision that...
research
01/06/2022

Consistent Style Transfer

Recently, attentional arbitrary style transfer methods have been propose...
research
09/19/2023

Retinex-guided Channel-grouping based Patch Swap for Arbitrary Style Transfer

The basic principle of the patch-matching based style transfer is to sub...
research
11/08/2021

Content-aware media retargeting based on deep importance map

We present a neural network to estimate the visual information of import...
research
05/13/2021

SAFIN: Arbitrary Style Transfer With Self-Attentive Factorized Instance Normalization

Artistic style transfer aims to transfer the style characteristics of on...
research
05/04/2021

Attention-based Stylisation for Exemplar Image Colourisation

Exemplar-based colourisation aims to add plausible colours to a grayscal...
research
12/08/2022

All-to-key Attention for Arbitrary Style Transfer

Attention-based arbitrary style transfer studies have shown promising pe...

Please sign up or login with your details

Forgot password? Click here to reset