DeepAI AI Chat
Log In Sign Up

Data@Hand: Fostering Visual Exploration of Personal Data on Smartphones Leveraging Speech and Touch Interaction

by   Young-Ho Kim, et al.
University of Maryland

Most mobile health apps employ data visualization to help people view their health and activity data, but these apps provide limited support for visual data exploration. Furthermore, despite its huge potential benefits, mobile visualization research in the personal data context is sparse. This work aims to empower people to easily navigate and compare their personal health data on smartphones by enabling flexible time manipulation with speech. We designed and developed Data@Hand, a mobile app that leverages the synergy of two complementary modalities: speech and touch. Through an exploratory study with 13 long-term Fitbit users, we examined how multimodal interaction helps participants explore their own health data. Participants successfully adopted multimodal interaction (i.e., speech and touch) for convenient and fluid data exploration. Based on the quantitative and qualitative findings, we discuss design implications and opportunities with multimodal interaction for better supporting visual data exploration on mobile devices.


page 2

page 3

page 7

page 10

page 12

page 14

page 15

page 16


Synapse: Interactive Guidance by Demonstration with Trial-and-Error Support for Older Adults to Use Smartphone Apps

As smartphones are widely adopted, mobile applications (apps) are emergi...

Interweaving Multimodal Interaction with Flexible Unit Visualizations for Data Exploration

Multimodal interfaces that combine direct manipulation and natural langu...

Activity River: Visualizing Planned and Logged Personal Activities for Reflection

We present Activity River, a personal visualization tool which enables i...

InChorus: Designing Consistent Multimodal Interactions for Data Visualization on Tablet Devices

While tablet devices are a promising platform for data visualization, su...

Towards Proxemic Mobile Collocated Interactions

Research on mobile collocated interactions has been exploring situations...

Visual Behaviors and Mobile Information Acquisition

It is common for people to engage in information acquisition tasks while...