A Consumer-tier based Visual-Brain Machine Interface for Augmented Reality Glasses Interactions

by   Yuying Jiang, et al.

Objective.Visual-Brain Machine Interface(V-BMI) has provide a novel interaction technique for Augmented Reality (AR) industries. Several state-of-arts work has demonstates its high accuracy and real-time interaction capbilities. However, most of the studies employ EEGs devices that are rigid and difficult to apply in real-life AR glasseses application sceniraros. Here we develop a consumer-tier Visual-Brain Machine Inteface(V-BMI) system specialized for Augmented Reality(AR) glasses interactions. Approach. The developed system consists of a wearable hardware which takes advantages of fast set-up, reliable recording and comfortable wearable experience that specificized for AR glasses applications. Complementing this hardware, we have devised a software framework that facilitates real-time interactions within the system while accommodating a modular configuration to enhance scalability. Main results. The developed hardware is only 110g and 120x85x23 mm, which with 1 Tohm and peak to peak voltage is less than 1.5 uV, and a V-BMI based angry bird game and an Internet of Thing (IoT) AR applications are deisgned, we demonstrated such technology merits of intuitive experience and efficiency interaction. The real-time interaction accuracy is between 85 and 96 percentages in a commercial AR glasses (DTI is 2.24s and ITR 65 bits-min ). Significance. Our study indicates the developed system can provide an essential hardware-software framework for consumer based V-BMI AR glasses. Also, we derive several pivotal design factors for a consumer-grade V-BMI-based AR system: 1) Dynamic adaptation of stimulation patterns-classification methods via computer vision algorithms is necessary for AR glasses applications; and 2) Algorithmic localization to foster system stability and latency reduction.


page 3

page 6

page 8

page 9

page 10

page 12


Experimental Augmented Reality User Experience

Augmented Reality (AR) is an emerging field ripe for experimentation, es...

Experiences with User Studies in Augmented Reality

The research field of augmented reality (AR) is of increasing popularity...

A Brain-Computer Interface Augmented Reality Framework with Auto-Adaptive SSVEP Recognition

Brain-Computer Interface (BCI) initially gained attention for developing...

Developing a Lecture Video Recording System Using Augmented Reality

Assistive technology is a prerequisite for making a high-quality lecture...

Real-Time Onboard Object Detection for Augmented Reality: Enhancing Head-Mounted Display with YOLOv8

This paper introduces a software architecture for real-time object detec...

On the Ruin of Age of Information in Augmented Reality over Wireless Terahertz (THz) Networks

Guaranteeing fresh and reliable information for augmented reality (AR) s...

Please sign up or login with your details

Forgot password? Click here to reset