A Taxonomy of Prompt Modifiers for Text-To-Image Generation

04/20/2022
by   Jonas Oppenlaender, et al.
0

Text-to-image generation has seen an explosion of interest since 2021. Today, beautiful and intriguing digital images and artworks can be synthesized from textual inputs ("prompts") with deep generative models. Online communities around text-to-image generation and AI generated art have quickly emerged. This paper identifies six types of prompt modifiers used by practitioners in the online community based on a 3-month ethnographic study. The novel taxonomy of prompt modifiers provides researchers a conceptual starting point for investigating the practice of text-to-image generation, but may also help practitioners of AI generated art improve their images. We further outline how prompt modifiers are applied in the practice of "prompt engineering." We discuss research opportunities of this novel creative practice in the field of Human-Computer Interaction (HCI). The paper concludes with a discussion of broader implications of prompt engineering from the perspective of Human-AI Interaction (HAI) in future applications beyond the use case of text-to-image generation and AI generated art.

READ FULL TEXT
research
05/13/2022

The Creativity of Text-to-Image Generation

Text-to-image synthesis has made a giant leap towards becoming a mainstr...
research
06/20/2023

The Cultivated Practices of Text-to-Image Generation

Humankind is entering a novel creative era in which anybody can synthesi...
research
05/31/2023

AI Imagery and the Overton Window

AI-based text-to-image generation has undergone a significant leap in th...
research
03/13/2023

Prompting AI Art: An Investigation into the Creative Skill of Prompt Engineering

Humankind is entering a novel era of creativity - an era in which anybod...
research
05/18/2023

AIwriting: Relations Between Image Generation and Digital Writing

During 2022, both transformer-based AI text generation sys-tems such as ...
research
02/24/2023

"An Adapt-or-Die Type of Situation": Perception, Adoption, and Use of Text-To-Image-Generation AI by Game Industry Professionals

Text-to-image generation (TTIG) models, a recent addition to creative AI...
research
03/08/2023

A Prompt Log Analysis of Text-to-Image Generation Systems

Recent developments in large language models (LLM) and generative AI hav...

Please sign up or login with your details

Forgot password? Click here to reset