Diffusion Explainer: Visual Explanation for Text-to-image Stable Diffusion

05/04/2023
by   Seongmin Lee, et al.
5

Diffusion-based generative models' impressive ability to create convincing images has captured global attention. However, their complex internal structures and operations often make them difficult for non-experts to understand. We present Diffusion Explainer, the first interactive visualization tool that explains how Stable Diffusion transforms text prompts into images. Diffusion Explainer tightly integrates a visual overview of Stable Diffusion's complex components with detailed explanations of their underlying operations, enabling users to fluidly transition between multiple levels of abstraction through animations and interactive elements. By comparing the evolutions of image representations guided by two related text prompts over refinement timesteps, users can discover the impact of prompts on image generation. Diffusion Explainer runs locally in users' web browsers without the need for installation or specialized hardware, broadening the public's education access to modern AI techniques. Our open-sourced tool is available at: https://poloclub.github.io/diffusion-explainer/. A video demo is available at https://youtu.be/Zg4gxdIWDds.

READ FULL TEXT

page 1

page 4

research
09/25/2022

Personalizing Text-to-Image Generation via Aesthetic Gradients

This work proposes aesthetic gradients, a method to personalize a CLIP-c...
research
01/05/2023

What is in a Text-to-Image Prompt: The Potential of Stable Diffusion in Visual Arts Education

Text-to-Image artificial intelligence (AI) recently saw a major breakthr...
research
04/12/2022

VisCUIT: Visual Auditor for Bias in CNN Image Classifier

CNN image classifiers are widely used, thanks to their efficiency and ac...
research
01/07/2020

CNN 101: Interactive Visual Learning for Convolutional Neural Networks

The success of deep learning solving previously-thought hard problems ha...
research
06/14/2018

Interactive Classification for Deep Learning Interpretation

We present an interactive system enabling users to manipulate images to ...
research
02/16/2023

Exploring the Representation Manifolds of Stable Diffusion Through the Lens of Intrinsic Dimension

Prompting has become an important mechanism by which users can more effe...
research
06/01/2023

FigGen: Text to Scientific Figure Generation

The generative modeling landscape has experienced tremendous growth in r...

Please sign up or login with your details

Forgot password? Click here to reset