Best Prompts for Text-to-Image Models and How to Find Them

09/23/2022
by   Nikita Pavlichenko, et al.
0

Recent progress in generative models, especially in text-guided diffusion models, has enabled the production of aesthetically-pleasing imagery resembling the works of professional human artists. However, one has to carefully compose the textual description, called the prompt, and augment it with a set of clarifying keywords. Since aesthetics are challenging to evaluate computationally, human feedback is needed to determine the optimal prompt formulation and keyword combination. In this paper, we present a human-in-the-loop approach to learning the most useful combination of prompt keywords using a genetic algorithm. We also show how such an approach can improve the aesthetic appeal of images depicting the same descriptions.

READ FULL TEXT

page 2

page 11

research
12/11/2022

FastClass: A Time-Efficient Approach to Weakly-Supervised Text Classification

Weakly-supervised text classification aims to train a classifier using o...
research
05/31/2023

AI Imagery and the Overton Window

AI-based text-to-image generation has undergone a significant leap in th...
research
07/19/2023

FABRIC: Personalizing Diffusion Models with Iterative Feedback

In an era where visual content generation is increasingly driven by mach...
research
07/22/2021

Semantic Text-to-Face GAN -ST^2FG

Faces generated using generative adversarial networks (GANs) have reache...
research
09/22/2022

Implementing and Experimenting with Diffusion Models for Text-to-Image Generation

Taking advantage of the many recent advances in deep learning, text-to-i...
research
01/08/2020

REST: A thread embedding approach for identifying and classifying user-specified information in security forums

How can we extract useful information from a security forum? We focus on...
research
05/15/2017

Learning Semantics for Image Annotation

Image search and retrieval engines rely heavily on textual annotation in...

Please sign up or login with your details

Forgot password? Click here to reset