Style Transfer with Target Feature Palette and Attention Coloring

11/07/2021
by   Suhyeon Ha, et al.
5

Style transfer has attracted a lot of attentions, as it can change a given image into one with splendid artistic styles while preserving the image structure. However, conventional approaches easily lose image details and tend to produce unpleasant artifacts during style transfer. In this paper, to solve these problems, a novel artistic stylization method with target feature palettes is proposed, which can transfer key features accurately. Specifically, our method contains two modules, namely feature palette composition (FPC) and attention coloring (AC) modules. The FPC module captures representative features based on K-means clustering and produces a feature target palette. The following AC module calculates attention maps between content and style images, and transfers colors and patterns based on the attention map and the target palette. These modules enable the proposed stylization to focus on key features and generate plausibly transferred images. Thus, the contributions of the proposed method are to propose a novel deep learning-based style transfer method and present target feature palette and attention coloring modules, and provide in-depth analysis and insight on the proposed method via exhaustive ablation study. Qualitative and quantitative results show that our stylized images exhibit state-of-the-art performance, with strength in preserving core structures and details of the content image.

READ FULL TEXT

page 11

page 12

page 13

page 14

page 15

page 16

page 17

page 18

research
01/02/2023

Edge Enhanced Image Style Transfer via Transformers

In recent years, arbitrary image style transfer has attracted more and m...
research
05/27/2020

Arbitrary Style Transfer via Multi-Adaptation Network

Arbitrary style transfer is a significant topic with both research value...
research
05/23/2017

Universal Style Transfer via Feature Transforms

Universal style transfer aims to transfer arbitrary visual styles to con...
research
04/02/2023

Learning Dynamic Style Kernels for Artistic Style Transfer

Arbitrary style transfer has been demonstrated to be efficient in artist...
research
03/19/2019

Mask-guided Style Transfer Network for Purifying Real Images

Recently, the progress of learning-by-synthesis has proposed a training ...
research
05/04/2021

Attention-based Stylisation for Exemplar Image Colourisation

Exemplar-based colourisation aims to add plausible colours to a grayscal...
research
01/02/2019

Ancient Painting to Natural Image: A New Solution for Painting Processing

Collecting a large-scale and well-annotated dataset for image processing...

Please sign up or login with your details

Forgot password? Click here to reset