Style Mixer: Semantic-aware Multi-Style Transfer Network

10/29/2019
by   Zixuan Huang, et al.
15

Recent neural style transfer frameworks have obtained astonishing visual quality and flexibility in Single-style Transfer (SST), but little attention has been paid to Multi-style Transfer (MST) which refers to simultaneously transferring multiple styles to the same image. Compared to SST, MST has the potential to create more diverse and visually pleasing stylization results. In this paper, we propose the first MST framework to automatically incorporate multiple styles into one result based on regional semantics. We first improve the existing SST backbone network by introducing a novel multi-level feature fusion module and a patch attention module to achieve better semantic correspondences and preserve richer style details. For MST, we designed a conceptually simple yet effective region-based style fusion module to insert into the backbone. It assigns corresponding styles to content regions based on semantic matching, and then seamlessly combines multiple styles together. Comprehensive evaluations demonstrate that our framework outperforms existing works of SST and MST.

READ FULL TEXT

page 1

page 3

page 6

page 7

page 9

page 10

page 11

page 12

research
06/03/2018

A Comprehensive Comparison between Neural Style Transfer and Universal Style Transfer

Style transfer aims to transfer arbitrary visual styles to content image...
research
04/29/2021

Towards Harmonized Regional Style Transfer and Manipulation for Facial Images

Regional facial image synthesis conditioned on semantic mask has achieve...
research
03/26/2019

SRM : A Style-based Recalibration Module for Convolutional Neural Networks

Following the advance of style transfer with Convolutional Neural Networ...
research
04/25/2019

LADN: Local Adversarial Disentangling Network for Facial Makeup and De-Makeup

We propose a local adversarial disentangling network (LADN) for facial m...
research
09/29/2021

Detailed Region-Adaptive Normalization for Heavy Makeup Transfer

In recent years, facial makeup transfer has attracted growing attention ...
research
10/16/2020

Anisotropic Stroke Control for Multiple Artists Style Transfer

Though significant progress has been made in artistic style transfer, se...
research
12/19/2022

ColoristaNet for Photorealistic Video Style Transfer

Photorealistic style transfer aims to transfer the artistic style of an ...

Please sign up or login with your details

Forgot password? Click here to reset