The Creativity of Text-to-Image Generation

05/13/2022
by   Jonas Oppenlaender, et al.
0

Text-to-image synthesis has made a giant leap towards becoming a mainstream phenomenon since 2021. With text-to-image systems, anybody can create digital images and artworks. This provokes the question of whether text-to-image art is creative. This paper expounds on the nature of human creativity involved in text-to-image art with a specific focus on the practice of "prompt engineering". The paper argues that the current product-centered view of creativity may fall short in the context of text-to-image generation. A case exemplifying this shortcoming is provided and the importance of online communities for the creative ecosystem of text-to-image art is highlighted. We provide a high-level summary of this online ecosystem drawing on Rhodes's conceptual model of creativity. We provide a discussion on the challenges for evaluating the creativity of text-to-image generation and discuss opportunities for research on text-to-image art in the field of Human-Computer Interaction (HCI).

READ FULL TEXT
research
04/20/2022

A Taxonomy of Prompt Modifiers for Text-To-Image Generation

Text-to-image generation has seen an explosion of interest since 2021. T...
research
02/17/2023

Grimm in Wonderland: Prompt Engineering with Midjourney to Illustrate Fairytales

The quality of text-to-image generation is continuously improving, yet t...
research
06/20/2023

The Cultivated Practices of Text-to-Image Generation

Humankind is entering a novel creative era in which anybody can synthesi...
research
04/04/2023

Toward Verifiable and Reproducible Human Evaluation for Text-to-Image Generation

Human evaluation is critical for validating the performance of text-to-i...
research
06/05/2023

Composition and Deformance: Measuring Imageability with a Text-to-Image Model

Although psycholinguists and psychologists have long studied the tendenc...
research
05/18/2023

AIwriting: Relations Between Image Generation and Digital Writing

During 2022, both transformer-based AI text generation sys-tems such as ...
research
03/13/2023

Prompting AI Art: An Investigation into the Creative Skill of Prompt Engineering

Humankind is entering a novel era of creativity - an era in which anybod...

Please sign up or login with your details

Forgot password? Click here to reset