Distribution Aligned Multimodal and Multi-Domain Image Stylization

06/02/2020
by   Minxuan Lin, et al.
0

Multimodal and multi-domain stylization are two important problems in the field of image style transfer. Currently, there are few methods that can perform both multimodal and multi-domain stylization simultaneously. In this paper, we propose a unified framework for multimodal and multi-domain style transfer with the support of both exemplar-based reference and randomly sampled guidance. The key component of our method is a novel style distribution alignment module that eliminates the explicit distribution gaps between various style domains and reduces the risk of mode collapse. The multimodal diversity is ensured by either guidance from multiple images or random style code, while the multi-domain controllability is directly achieved by using a domain label. We validate our proposed framework on painting style transfer with a variety of different artistic styles and genres. Qualitative and quantitative comparisons with state-of-the-art methods demonstrate that our method can generate high-quality results of multi-domain styles and multimodal instances with reference style guidance or random sampled style.

READ FULL TEXT

page 4

page 5

page 6

page 7

page 8

research
11/26/2020

3DSNet: Unsupervised Shape-to-Shape 3D Style Transfer

Transferring the style from one image onto another is a popular and wide...
research
05/19/2022

Domain Enhanced Arbitrary Image Style Transfer via Contrastive Learning

In this work, we tackle the challenging problem of arbitrary image style...
research
02/26/2020

Multi-Attribute Guided Painting Generation

Controllable painting generation plays a pivotal role in image stylizati...
research
11/28/2022

Realtime Fewshot Portrait Stylization Based On Geometric Alignment

This paper presents a portrait stylization method designed for real-time...
research
04/22/2023

Two Birds, One Stone: A Unified Framework for Joint Learning of Image and Video Style Transfers

Current arbitrary style transfer models are limited to either image or v...
research
09/02/2021

Domain-Robust Mitotic Figure Detection with StyleGAN

We propose a new training scheme for domain generalization in mitotic fi...
research
08/10/2021

Domain-Aware Universal Style Transfer

Style transfer aims to reproduce content images with the styles from ref...

Please sign up or login with your details

Forgot password? Click here to reset