Emerging Natural User Interfaces in Mobile Computing: A Bottoms-Up Survey

by   Kirill A. Shatilov, et al.

Mobile and wearable interfaces and interaction paradigms are highly constrained by the available screen real estate, and the computational and power resources. Although there exist many ways of displaying information to mobile users, inputting data to a mobile device is, usually, limited to a conventional touchbased interaction, that distracts users from their ongoing activities. Furthermore, emerging applications, like augmented, mixed and virtual reality (AR/MR/VR), require new types of input methods in order to interact with complex virtual worlds, challenging the traditional techniques of Human-Computer Interaction (HCI). Leveraging of Natural User Interfaces (NUIs), as a paradigm of using natural intuitive actions to interact with computing systems, is one ofmany ways to meet these challenges in mobile computing and its modern applications. Brain-Machine Interfaces that enable thought-only hands-free interaction, Myoelectric input methods that track body gestures and gaze-tracking input interfaces - are the examples of NUIs applicable to mobile and wearable interactions. The wide adoption ofwearable devices and the penetration ofmobile technologies, alongside with the growing market ofAR/MR/VR, motivates the exploration and implementation of new interaction paradigms. The concurrent development of bio-signal acquisition techniques and accompanying ecosystems offers a useful toolbox to address open challenges.In this survey, we present state-of-the-art bio-signal acquisition methods, summarize and evaluate recent developments in the area of NUIs and outline potential application in mobile scenarios. The survey will provide a bottoms-up overview starting from (i) underlying biological aspects and signal acquisition techniques, (ii) portable NUI hardware solutions, (iii) NUI-enabled applications, as well as (iv) research challenges and open problems.


page 4

page 7

page 8

page 31

page 32

page 33


Mixed Reality Interaction Techniques

This chapter gives an overview of interaction techniques for mixed reali...

Breaking the Screen: Interaction Across Touchscreen Boundaries in Virtual Reality for Mobile Knowledge Workers

Virtual Reality (VR) has the potential to transform knowledge work. One ...

Real-Time Recognition of In-Place Body Actions and Head Gestures using Only a Head-Mounted Display

Body actions and head gestures are natural interfaces for interaction in...

Security and Privacy Approaches in Mixed Reality: A Literature Survey

Mixed reality (MR) technology is now gaining ground due to advances in c...

Surface Electromyography as a Natural Human-Machine Interface: A Review

Surface electromyography (sEMG) is a non-invasive method of measuring ne...

Ephemeral Fabrication: Exploring a Ubiquitous Fabrication Scenario of Low-Effort, In-Situ Creation of Short-Lived Physical Artifacts

Personal fabrication empowers users to create objects increasingly easie...

When Brain-Computer Interfaces Meet the Metaverse: Landscape, Demonstrator, Trends, Challenges, and Concerns

The metaverse has gained tremendous popularity in recent years, allowing...

Please sign up or login with your details

Forgot password? Click here to reset