DeepAI AI Chat
Log In Sign Up

Eliciting Gestures for Novel Note-taking Interactions

by   Katy Ilonka Gero, et al.
Columbia University

Handwriting recognition is improving in leaps and bounds, and this opens up new opportunities for stylus-based interactions. In particular, note-taking applications can become a more intelligent user interface, incorporating new features like autocomplete and integrated search. In this work we ran a gesture elicitation study, asking 21 participants to imagine how they would interact with an imaginary, intelligent note-taking application. We report agreement on the elicited gestures, finding that while existing common interactions are prevalent (like double taps and long presses) a number of more novel interactions (like dragging selected items to hotspots or using annotations) were also well-represented. We discuss the mental models participants drew on when explaining their gestures and what kind of feedback users might need to move to more stylus-centric interactions.


Iterative Design of Gestures during Elicitation: A Gateway into User's Mental Models

The design of gestural interfaces through gesture elicitation studies is...

Understanding the Design Space of Mouth Microgestures

As wearable devices move toward the face (i.e. smart earbuds, glasses), ...

Gesture Agreement Assessment Using Description Vectors

Participatory design is a popular design technique that involves the end...

Accelerography: Feasibility of Gesture Typing using Accelerometer

In this paper, we aim to look into the feasibility of constructing alpha...

Selecting a Small Set of Optimal Gestures from an Extensive Lexicon

Finding the best set of gestures to use for a given computer recognition...

MAGIC: Manipulating Avatars and Gestures to Improve Remote Collaboration

Remote collaborative work has become pervasive in many settings, from en...

Haptic Interactions for Extended Reality

This research investigates whether the interaction methods of XR headset...