A Word is Worth a Thousand Pictures: Prompts as AI Design Material

03/22/2023
by   Chinmay Kulkarni, et al.
0

Recent advances in Machine-Learning have led to the development of models that generate images based on a text description.Such large prompt-based text to image models (TTIs), trained on a considerable amount of data, allow the creation of high-quality images by users with no graphics or design training. This paper examines the role such TTI models can playin collaborative, goal-oriented design. Through a within-subjects study with 14 non-professional designers, we find that such models can help participants explore a design space rapidly and allow for fluid collaboration. We also find that text inputs to such models ("prompts") act as reflective design material, facilitating exploration, iteration, and reflection in pair design. This work contributes to the future of collaborative design supported by generative AI by providing an account of how text-to-image models influence the design process and the social dynamics around design and suggesting implications for tool design

READ FULL TEXT

page 10

page 11

page 12

page 15

research
04/25/2023

Generating Procedural Materials from Text or Image Prompts

Node graph systems are used ubiquitously for material design in computer...
research
06/01/2022

When happy accidents spark creativity: Bringing collaborative speculation to life with generative AI

Generative AI techniques like those that synthesize images from text (te...
research
10/20/2022

3DALL-E: Integrating Text-to-Image AI in 3D Design Workflows

Text-to-image AI systems are capable of generating novel images for insp...
research
01/23/2023

The Entoptic Field Camera as Metaphor-Driven Research-through-Design with AI Technologies

Artificial intelligence (AI) technologies are widely deployed in smartph...
research
11/27/2017

Collaborative Evolution of 3D Models

We present a computational model of creative design based on collaborati...
research
02/01/2023

Trash to Treasure: Using text-to-image models to inform the design of physical artefacts

Text-to-image generative models have recently exploded in popularity and...
research
02/17/2023

ImageAssist: Tools for Enhancing Touchscreen-Based Image Exploration Systems for Blind and Low Vision Users

Blind and low vision (BLV) users often rely on alt text to understand wh...

Please sign up or login with your details

Forgot password? Click here to reset