DeepAI AI Chat
Log In Sign Up

Emerging Natural User Interfaces in Mobile Computing: A Bottoms-Up Survey

11/12/2019
by   Kirill A. Shatilov, et al.
0

Mobile and wearable interfaces and interaction paradigms are highly constrained by the available screen real estate, and the computational and power resources. Although there exist many ways of displaying information to mobile users, inputting data to a mobile device is, usually, limited to a conventional touchbased interaction, that distracts users from their ongoing activities. Furthermore, emerging applications, like augmented, mixed and virtual reality (AR/MR/VR), require new types of input methods in order to interact with complex virtual worlds, challenging the traditional techniques of Human-Computer Interaction (HCI). Leveraging of Natural User Interfaces (NUIs), as a paradigm of using natural intuitive actions to interact with computing systems, is one ofmany ways to meet these challenges in mobile computing and its modern applications. Brain-Machine Interfaces that enable thought-only hands-free interaction, Myoelectric input methods that track body gestures and gaze-tracking input interfaces - are the examples of NUIs applicable to mobile and wearable interactions. The wide adoption ofwearable devices and the penetration ofmobile technologies, alongside with the growing market ofAR/MR/VR, motivates the exploration and implementation of new interaction paradigms. The concurrent development of bio-signal acquisition techniques and accompanying ecosystems offers a useful toolbox to address open challenges.In this survey, we present state-of-the-art bio-signal acquisition methods, summarize and evaluate recent developments in the area of NUIs and outline potential application in mobile scenarios. The survey will provide a bottoms-up overview starting from (i) underlying biological aspects and signal acquisition techniques, (ii) portable NUI hardware solutions, (iii) NUI-enabled applications, as well as (iv) research challenges and open problems.

READ FULL TEXT

page 4

page 7

page 8

page 31

page 32

page 33

03/10/2021

Mixed Reality Interaction Techniques

This chapter gives an overview of interaction techniques for mixed reali...
08/11/2020

Breaking the Screen: Interaction Across Touchscreen Boundaries in Virtual Reality for Mobile Knowledge Workers

Virtual Reality (VR) has the potential to transform knowledge work. One ...
02/25/2023

Real-Time Recognition of In-Place Body Actions and Head Gestures using Only a Head-Mounted Display

Body actions and head gestures are natural interfaces for interaction in...
09/03/2017

A survey on haptic technologies for mobile augmented reality

Augmented Reality (AR) and Mobile Augmented Reality (MAR) applications h...
03/02/2021

Natural interaction with traffic control cameras through multimodal interfaces

Human-Computer Interfaces have always played a fundamental role in usabi...