Designerly Understanding: Information Needs for Model Transparency to Support Design Ideation for AI-Powered User Experience

02/21/2023
by   Q Vera Liao, et al.
0

Despite the widespread use of artificial intelligence (AI), designing user experiences (UX) for AI-powered systems remains challenging. UX designers face hurdles understanding AI technologies, such as pre-trained language models, as design materials. This limits their ability to ideate and make decisions about whether, where, and how to use AI. To address this problem, we bridge the literature on AI design and AI transparency to explore whether and how frameworks for transparent model reporting can support design ideation with pre-trained models. By interviewing 23 UX practitioners, we find that practitioners frequently work with pre-trained models, but lack support for UX-led ideation. Through a scenario-based design task, we identify common goals that designers seek model understanding for and pinpoint their model transparency information needs. Our study highlights the pivotal role that UX designers can play in Responsible AI and calls for supporting their understanding of AI limitations through model transparency and interrogation.

READ FULL TEXT

page 6

page 9

research
06/30/2021

Zombies in the Loop? People are Insensitive to the Transparency of AI-Powered Moral Advisors

Departing from the assumption that AI needs to be transparent to be trus...
research
03/09/2023

Users are the North Star for AI Transparency

Despite widespread calls for transparent artificial intelligence systems...
research
01/24/2022

Evaluating a Methodology for Increasing AI Transparency: A Case Study

In reaction to growing concerns about the potential harms of artificial ...
research
06/02/2023

AI Transparency in the Age of LLMs: A Human-Centered Research Roadmap

The rise of powerful large language models (LLMs) brings about tremendou...
research
11/11/2019

Experiences with Improving the Transparency of AI Models and Services

AI models and services are used in a growing number of highstakes areas,...
research
09/07/2023

Chat Failures and Troubles: Reasons and Solutions

This paper examines some common problems in Human-Robot Interaction (HRI...
research
02/22/2023

fAIlureNotes: Supporting Designers in Understanding the Limits of AI Models for Computer Vision Tasks

To design with AI models, user experience (UX) designers must assess the...

Please sign up or login with your details

Forgot password? Click here to reset