AI Chat

Investigating Prompt Engineering in Diffusion Models

11/21/2022

∙

by Sam Witteveen, et al.

∙

reddragon.ai

∙

∙

With the spread of the use of Text2Img diffusion models such as DALL-E 2, Imagen, Mid Journey and Stable Diffusion, one challenge that artists face is selecting the right prompts to achieve the desired artistic output. We present techniques for measuring the effect that specific words and phrases in prompts have, and (in the Appendix) present guidance on the selection of prompts to produce desired effects.

Sam Witteveen
9 publications
Martin Andrews
11 publications

page 5

page 6

page 7

page 8

page 10

∙ 02/14/2023

Universal Guidance for Diffusion Models

Typical diffusion models are trained to accept a particular form of cond...

0 Arpit Bansal, et al. ∙

∙ 12/27/2022

DiffFace: Diffusion-based Face Swapping with Facial Guidance

In this paper, we propose a diffusion-based face swapping framework for ...

0 Kihong Kim, et al. ∙

∙ 06/16/2023

Drag-guided diffusion models for vehicle image generation

Denoising diffusion models trained at web-scale have revolutionized imag...

0 Nikos Arechiga, et al. ∙

∙ 12/07/2022

Diffusion Art or Digital Forgery? Investigating Data Replication in Diffusion Models

Cutting-edge diffusion models produce images with high quality and custo...

0 Gowthami Somepalli, et al. ∙

∙ 02/25/2023

Directed Diffusion: Direct Control of Object Placement through Attention Guidance

Text-guided diffusion models such as DALLE-2, IMAGEN, and Stable Diffusi...

0 Wan-Duo Kurt Ma, et al. ∙

∙ 07/05/2023

Diffusion Models for Computational Design at the Example of Floor Plans

AI Image generators based on diffusion models are widely discussed recen...

0 Joern Ploennigs, et al. ∙

∙ 01/25/2023

Imitating Human Behaviour with Diffusion Models

Diffusion models have emerged as powerful generative models in the text-...

0 Tim Pearce, et al. ∙