Singer Identification for Metaverse with Timbral and Middle-Level Perceptual Features

05/24/2022
by   Xulong Zhang, et al.
0

Metaverse is an interactive world that combines reality and virtuality, where participants can be virtual avatars. Anyone can hold a concert in a virtual concert hall, and users can quickly identify the real singer behind the virtual idol through the singer identification. Most singer identification methods are processed using the frame-level features. However, expect the singer's timbre, the music frame includes music information, such as melodiousness, rhythm, and tonal. It means the music information is noise for using frame-level features to identify the singers. In this paper, instead of only the frame-level features, we propose to use another two features that address this problem. Middle-level feature, which represents the music's melodiousness, rhythmic stability, and tonal stability, and is able to capture the perceptual features of music. The timbre feature, which is used in speaker identification, represents the singers' voice features. Furthermore, we propose a convolutional recurrent neural network (CRNN) to combine three features for singer identification. The model firstly fuses the frame-level feature and timbre feature and then combines middle-level features to the mix features. In experiments, the proposed method achieves comparable performance on an average F1 score of 0.81 on the benchmark dataset of Artist20, which significantly improves related works.

READ FULL TEXT
research
03/03/2023

Decoding and Visualising Intended Emotion in an Expressive Piano Performance

Expert musicians can mould a musical piece to convey specific emotions t...
research
01/14/2019

Music Artist Classification with Convolutional Recurrent Neural Networks

Previous attempts at music artist classification use frame-level audio f...
research
12/16/2017

Automatic Music Highlight Extraction using Convolutional Recurrent Attention Networks

Music highlights are valuable contents for music services. Most methods ...
research
04/09/2020

Music Artist Classification with WaveNet Classifier for Raw Waveform Audio Data

Models for music artist classification usually were operated in the freq...
research
07/08/2019

Towards Explainable Music Emotion Recognition: The Route via Mid-level Features

Emotional aspects play an important part in our interaction with music. ...
research
08/22/2023

Modeling Bends in Popular Music Guitar Tablatures

Tablature notation is widely used in popular music to transcribe and sha...
research
02/20/2021

Singer Identification Using Deep Timbre Feature Learning with KNN-Net

In this paper, we study the issue of automatic singer identification (SI...

Please sign up or login with your details

Forgot password? Click here to reset