Toward Imagined Speech based Smart Communication System: Potential Applications on Metaverse Conditions

by   Seo-Hyun Lee, et al.

Metaverse provides an alternative platform for human interaction in the virtual world. Since virtual platform holds few restrictions in changing the surrounding environments or the appearance of the avatars, it can serve as a platform that reflects human thoughts or even dreams at least in the metaverse world. When it is merged together with the current brain-computer interface (BCI) technology, which enables system control via brain signals, a new paradigm of human interaction through mind may be established in the metaverse conditions. Recent BCI systems are aiming to provide user-friendly and intuitive means of communication using brain signals. Imagined speech has become an alternative neuro-paradigm for communicative BCI since it relies directly on a person's speech production process, rather than using speech-unrelated neural activity as the means of communication. In this paper, we propose a brain-to-speech (BTS) system for real-world smart communication using brain signals. Also, we show a demonstration of imagined speech based smart home control through communication with a virtual assistant, which can be one of the future applications of brain-metaverse system. We performed pseudo-online analysis using imagined speech electroencephalography data of nine subjects to investigate the potential use of virtual BTS system in the real-world. Average accuracy of 46.54 (chance level = 50 pseudo-online analysis, respectively. Our results support the potential of imagined speech based smart communication to be applied in the metaverse world.


page 1

page 2

page 3


A BCI based Smart Home System Combined with Event-related Potentials and Speech Imagery Task

Recently, smart home systems based on brain-computer interface (BCI) has...

A Human-Centric Metaverse Enabled by Brain-Computer Interface: A Survey

The growing interest in the Metaverse has generated momentum for members...

Directly wireless communication of human minds via non-invasive brain-computer-metasurface platform

Brain-computer interfaces (BCIs), invasive or non-invasive, have project...

Generating Music and Generative Art from Brain activity

Nowadays, technological advances have influenced all human activities, c...

Detecting Distrust Towards the Skills of a Virtual Assistant Using Speech

Research has shown that trust is an essential aspect of human-computer i...

Older Adults and Brain-Computer Interface: An Exploratory Study

In this exploratory study, we examine the possibilities of non-invasive ...

A Survey on Brain-Computer Interface and Related Applications

BCI systems are able to communicate directly between the brain and compu...

Please sign up or login with your details

Forgot password? Click here to reset