Avatar Fusion Karaoke: Research and development on multi-user music play VR experience in the metaverse

by   Alexandre Berthault, et al.

This paper contributes to building a standard process of research and development (R D) for new user experiences (UX) in metaverse services. We tested this R D process on a new UX proof of concept (PoC) for Meta Quest head-mounted display (HMDs) consisting of a school-life karaoke experience with the hypothesis that it is possible to design the avatars with only the necessary functions and rendering costs. The school life metaverse is a relevant subject for discovering issues and problems in this type of simultaneous connection. To qualitatively evaluate the potential of a multi-person metaverse experience, this study investigated subjects where each avatar requires expressive skills. While avatar play experiences feature artistic expressions, such as dancing, playing musical instruments, and drawing, and these can be used to evaluate their operability and expressive capabilities qualitatively, the Quest's tracking capabilities are insufficient for full-body performance and graphical art expression. Considering such hardware limitations, this study evaluated the Quest, focusing primarily on UX simplicity using AI Fusion techniques and expressiveness in instrumental scenes played by approximately four avatars. This research reported methods for multiuser metaverse communication and its supporting technologies, such as head-mounted devices and their graphics performance, special interaction techniques, and complementary tools and the importance of PoC development, its evaluation, and its iterations. The result is remarkable for further research; these expressive technologies in a multi-user context are directly related to the quality of communication within the metaverse and the value of the user-generated content (UGC) produced there.


page 1

page 4

page 5

page 6

page 7


Body, Clothes, Water, and Toys: Media Towards Natural Music Expressions with Digital Sounds

In this paper, we introduce our research challenges for creating new mus...

Isness: Using Multi-Person VR to Design Peak Mystical-Type Experiences Comparable to Psychedelics

Studies combining psychotherapy with psychedelic drugs (PsiDs) have demo...

Expressive Communication: A Common Framework for Evaluating Developments in Generative Models and Steering Interfaces

There is an increasing interest from ML and HCI communities in empowerin...

A Neophyte With AutoML: Evaluating the Promises of Automatic Machine Learning Tools

This paper discusses modern Auto Machine Learning (AutoML) tools from th...

A Qualitative Post-Experience Method for Evaluating Changes in VR Presence Experience Over Time

A particular measure to evaluate a head-mounted display (HMD) based expe...

Design Your Life: User-Initiated Design of Technology to Support Independent Living of Young Autistic Adults

This paper describes the development of and first experiences with 'Desi...

A2D: Anywhere Anytime Drumming

The drum kit, which has only been around for around 100 years, is a popu...

Please sign up or login with your details

Forgot password? Click here to reset