DeepAI AI Chat
Log In Sign Up

Eliciting Gestures for Novel Note-taking Interactions

12/22/2021
by   Katy Ilonka Gero, et al.
Google
Columbia University
0

Handwriting recognition is improving in leaps and bounds, and this opens up new opportunities for stylus-based interactions. In particular, note-taking applications can become a more intelligent user interface, incorporating new features like autocomplete and integrated search. In this work we ran a gesture elicitation study, asking 21 participants to imagine how they would interact with an imaginary, intelligent note-taking application. We report agreement on the elicited gestures, finding that while existing common interactions are prevalent (like double taps and long presses) a number of more novel interactions (like dragging selected items to hotspots or using annotations) were also well-represented. We discuss the mental models participants drew on when explaining their gestures and what kind of feedback users might need to move to more stylus-centric interactions.

READ FULL TEXT
04/10/2021

Iterative Design of Gestures during Elicitation: A Gateway into User's Mental Models

The design of gestural interfaces through gesture elicitation studies is...
06/02/2021

Understanding the Design Space of Mouth Microgestures

As wearable devices move toward the face (i.e. smart earbuds, glasses), ...
10/22/2019

Gesture Agreement Assessment Using Description Vectors

Participatory design is a popular design technique that involves the end...
03/29/2020

Accelerography: Feasibility of Gesture Typing using Accelerometer

In this paper, we aim to look into the feasibility of constructing alpha...
04/30/2014

Selecting a Small Set of Optimal Gestures from an Extensive Lexicon

Finding the best set of gestures to use for a given computer recognition...
02/15/2023

MAGIC: Manipulating Avatars and Gestures to Improve Remote Collaboration

Remote collaborative work has become pervasive in many settings, from en...
12/08/2022

Haptic Interactions for Extended Reality

This research investigates whether the interaction methods of XR headset...