StyleMC: Multi-Channel Based Fast Text-Guided Image Generation and Manipulation

12/15/2021
by   Umut Kocasari, et al.
0

Discovering meaningful directions in the latent space of GANs to manipulate semantic attributes typically requires large amounts of labeled data. Recent work aims to overcome this limitation by leveraging the power of Contrastive Language-Image Pre-training (CLIP), a joint text-image model. While promising, these methods require several hours of preprocessing or training to achieve the desired manipulations. In this paper, we present StyleMC, a fast and efficient method for text-driven image generation and manipulation. StyleMC uses a CLIP-based loss and an identity loss to manipulate images via a single text prompt without significantly affecting other attributes. Unlike prior work, StyleMC requires only a few seconds of training per text prompt to find stable global directions, does not require prompt engineering and can be used with any pre-trained StyleGAN2 model. We demonstrate the effectiveness of our method and compare it to state-of-the-art methods. Our code can be found at http://catlab-team.github.io/stylemc.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 1

page 5

page 6

page 10

page 11

page 12

page 13

page 14

03/31/2021

StyleCLIP: Text-Driven Manipulation of StyleGAN Imagery

Inspired by the ability of StyleGAN to generate highly realistic images ...
02/12/2022

Text and Image Guided 3D Avatar Generation and Manipulation

The manipulation of latent space has recently become an interesting topi...
11/26/2021

Predict, Prevent, and Evaluate: Disentangled Text-Driven Image Manipulation Empowered by Pre-Trained Vision-Language Model

To achieve disentangled image manipulation, previous works depend heavil...
05/11/2020

Conditional Image Generation and Manipulation for User-Specified Content

In recent years, Generative Adversarial Networks (GANs) have improved st...
03/16/2022

Fantastic Style Channels and Where to Find Them: A Submodular Framework for Discovering Diverse Directions in GANs

The discovery of interpretable directions in the latent spaces of pre-tr...
12/13/2021

Exploring Latent Dimensions of Crowd-sourced Creativity

Recently, the discovery of interpretable directions in the latent spaces...
02/23/2022

Discovering Multiple and Diverse Directions for Cognitive Image Properties

Recent research has shown that it is possible to find interpretable dire...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.