DALLE-URBAN: Capturing the urban design expertise of large text to image transformers

08/03/2022
by   Sachith Seneviratne, et al.
10

Automatically converting text descriptions into images using transformer architectures has recently received considerable attention. Such advances have implications for many applied design disciplines across fashion, art, architecture, urban planning, landscape design and the future tools available to such disciplines. However, a detailed analysis capturing the capabilities of such models, specifically with a focus on the built environment, has not been performed to date. In this work, we investigate the capabilities and biases of such text-to-image methods as it applies to the built environment in detail. We use a systematic grammar to generate queries related to the built environment and evaluate resulting generated images. We generate 1020 different images and find that text to image transformers are robust at generating realistic images across different domains for this use-case. Generated imagery can be found at the github: https://github.com/sachith500/DALLEURBAN

READ FULL TEXT

page 1

page 3

page 5

page 6

page 7

research
02/08/2022

DALL-Eval: Probing the Reasoning Skills and Social Biases of Text-to-Image Generative Transformers

Generating images from textual descriptions has gained a lot of attentio...
research
08/08/2023

Unifying Two-Stream Encoders with Transformers for Cross-Modal Retrieval

Most existing cross-modal retrieval methods employ two-stream encoders w...
research
03/27/2023

Anti-DreamBooth: Protecting users from personalized text-to-image synthesis

Text-to-image diffusion models are nothing but a revolution, allowing an...
research
11/19/2021

Grounded Situation Recognition with Transformers

Grounded Situation Recognition (GSR) is the task that not only classifie...
research
06/07/2023

Understanding Place Identity with Generative AI

Researchers are constantly leveraging new forms of data with the goal of...
research
08/26/2022

Region-guided CycleGANs for Stain Transfer in Whole Slide Images

In whole slide imaging, commonly used staining techniques based on hemat...

Please sign up or login with your details

Forgot password? Click here to reset