ITstyler: Image-optimized Text-based Style Transfer

01/26/2023
by   Yunpeng Bai, et al.
0

Text-based style transfer is a newly-emerging research topic that uses text information instead of style image to guide the transfer process, significantly extending the application scenario of style transfer. However, previous methods require extra time for optimization or text-image paired data, leading to limited effectiveness. In this work, we achieve a data-efficient text-based style transfer method that does not require optimization at the inference stage. Specifically, we convert text input to the style space of the pre-trained VGG network to realize a more effective style swap. We also leverage CLIP's multi-modal embedding space to learn the text-to-style mapping with the image dataset only. Our method can transfer arbitrary new styles of text input in real-time and synthesize high-quality artistic images.

READ FULL TEXT

page 1

page 3

page 5

page 6

page 7

page 8

research
10/07/2022

FastCLIPStyler: Towards fast text-based image style transfer using style representation

Artistic style transfer is usually performed between two images, a style...
research
04/10/2023

ITportrait: Image-Text Coupled 3D Portrait Domain Adaptation

Domain adaptation of 3D portraits has gained more and more attention. Ho...
research
02/04/2020

Lane Detection in Low-light Conditions Using an Efficient Data Enhancement : Light Conditions Style Transfer

Nowadays, deep learning techniques are widely used for lane detection, b...
research
05/03/2019

Controllable Artistic Text Style Transfer via Shape-Matching GAN

Artistic text style transfer is the task of migrating the style from a s...
research
10/06/2020

Plug and Play Autoencoders for Conditional Text Generation

Text autoencoders are commonly used for conditional generation tasks suc...
research
05/25/2023

CLIP3Dstyler: Language Guided 3D Arbitrary Neural Style Transfer

In this paper, we propose a novel language-guided 3D arbitrary neural st...
research
01/18/2017

Bringing Impressionism to Life with Neural Style Transfer in Come Swim

Neural Style Transfer is a striking, recently-developed technique that u...

Please sign up or login with your details

Forgot password? Click here to reset