"Hey Model!" – Natural User Interactions and Agency in Accessible Interactive 3D Models

09/01/2020
by   Samuel Reinders, et al.
0

While developments in 3D printing have opened up opportunities for improved access to graphical information for people who are blind or have low vision (BLV), they can provide only limited detailed and contextual information. Interactive 3D printed models (I3Ms) that provide audio labels and/or a conversational agent interface potentially overcome this limitation. We conducted a Wizard-of-Oz exploratory study to uncover the multi-modal interaction techniques that BLV people would like to use when exploring I3Ms, and investigated their attitudes towards different levels of model agency. These findings informed the creation of an I3M prototype of the solar system. A second user study with this model revealed a hierarchy of interaction, with BLV users preferring tactile exploration, followed by touch gestures to trigger audio labels, and then natural language to fill in knowledge gaps and confirm understanding.

READ FULL TEXT

page 4

page 7

research
06/12/2023

Designing Conversational Multimodal 3D Printed Models with People who are Blind

3D printed models have been used to improve access to graphical informat...
research
09/22/2022

Understandable Robots

Finally, the work will include an investigation of the contextual form o...
research
08/20/2019

StateLens: A Reverse Engineering Solution for Making Existing Dynamic Touchscreens Accessible

Blind people frequently encounter inaccessible dynamic touchscreens in t...
research
11/29/2017

A Multimodal Assistive System for Helping Visually Impaired in Social Interactions

Access to non-verbal cues in social interactions is vital for people wit...
research
05/19/2023

Sensecape: Enabling Multilevel Exploration and Sensemaking with Large Language Models

People are increasingly turning to large language models (LLMs) for comp...
research
04/21/2023

PiXi: Password Inspiration by Exploring Information

Passwords, a first line of defense against unauthorized access, must be ...
research
05/25/2023

Understanding Idea Creation in Collaborative Discourse through Networks: The Joint Attention-Interaction-Creation (AIC) Framework

In Computer-Supported Collaborative Learning, ideas generated through co...

Please sign up or login with your details

Forgot password? Click here to reset