GANSlider: How Users Control Generative Models for Images using Multiple Sliders with and without Feedforward Information

02/02/2022
by   Hai Dang, et al.
43

We investigate how multiple sliders with and without feedforward visualizations influence users' control of generative models. In an online study (N=138), we collected a dataset of people interacting with a generative adversarial network (StyleGAN2) in an image reconstruction task. We found that more control dimensions (sliders) significantly increase task difficulty and user actions. Visual feedforward partly mitigates this by enabling more goal-directed interaction. However, we found no evidence of faster or more accurate task performance. This indicates a tradeoff between feedforward detail and implied cognitive costs, such as attention. Moreover, we found that visualizations alone are not always sufficient for users to understand individual control dimensions. Our study quantifies fundamental UI design factors and resulting interaction behavior in this context, revealing opportunities for improvement in the UI design for interactive applications of generative models. We close by discussing design directions and further aspects.

READ FULL TEXT

page 1

page 3

page 8

page 9

page 14

page 15

research
09/14/2021

Design Guidelines for Prompt Engineering Text-to-Image Generative Models

Text-to-image generative models are a new and powerful way to generate v...
research
08/21/2020

Lyra 2: Designing Interactive Visualizations by Demonstration

Recent graphical interfaces offer direct manipulation mechanisms for aut...
research
05/27/2019

Universality Theorems for Generative Models

Despite the fact that generative models are extremely successful in prac...
research
12/13/2011

Supervised Generative Reconstruction: An Efficient Way To Flexibly Store and Recognize Patterns

Matching animal-like flexibility in recognition and the ability to quick...
research
02/10/2015

Generative Moment Matching Networks

We consider the problem of learning deep generative models from data. We...
research
04/17/2023

Attributing Image Generative Models using Latent Fingerprints

Generative models have enabled the creation of contents that are indisti...
research
04/22/2022

3D pride without 2D prejudice: Bias-controlled multi-level generative models for structure-based ligand design

Generative models for structure-based molecular design hold significant ...

Please sign up or login with your details

Forgot password? Click here to reset