Multi-person Spatial Interaction in a Large Immersive Display Using Smartphones as Touchpads

11/26/2019
by   Gyanendra Sharma, et al.
6

In this paper, we present a multi-user interaction interface for a large immersive space that supports simultaneous screen interactions by combining (1) user input via personal smartphones and Bluetooth microphones, (2) spatial tracking via an overhead array of Kinect sensors, and (3) WebSocket interfaces to a webpage running on the large screen. Users are automatically, dynamically assigned personal and shared screen sub-spaces based on their tracked location with respect to the screen, and use a webpage on their personal smartphone for touchpad-type input. We report user experiments using our interaction framework that involve image selection and placement tasks, with the ultimate goal of realizing display-wall environments as viable, interactive workspaces with natural multimodal interfaces.

READ FULL TEXT

page 1

page 4

page 5

page 6

research
03/14/2021

VXSlate: Combining Head Movement and Mobile Touch for Large Virtual Display Interaction

Virtual Reality (VR) headsets can open opportunities for users to accomp...
research
02/12/2020

C-D Ratio in multi-display environments

Research in user interaction with mixed reality environments using multi...
research
12/18/2019

Psychoacoustic Sonification as User Interface for Human-Machine Interaction

When operating a machine, the operator needs to know some spatial relati...
research
08/03/2022

SmartControllerJS: A JavaScript library to turn smartphones into controllers for web-based interactive experiments

We introduce SmartControllerJS, a new JavaScript library for fast, cost-...
research
03/31/2020

Multimodal Interfaces for Effective Teleoperation

Research in multi-modal interfaces aims to provide solutions to immersio...
research
08/31/2020

Shared Surfaces and Spaces: Collaborative Data Visualisation in a Co-located Immersive Environment

Immersive technologies offer new opportunities to support collaborative ...
research
11/19/2020

Experimenting Touchless Gestural Interaction for a University Public Web-based Display

Interest in and development of touchless gestural interfaces has recentl...

Please sign up or login with your details

Forgot password? Click here to reset