DeepAI AI Chat
Log In Sign Up

Score-informed Networks for Music Performance Assessment

08/01/2020
by   Jiawen Huang, et al.
Georgia Institute of Technology
0

The assessment of music performances in most cases takes into account the underlying musical score being performed. While there have been several automatic approaches for objective music performance assessment (MPA) based on extracted features from both the performance audio and the score, deep neural network-based methods incorporating score information into MPA models have not yet been investigated. In this paper, we introduce three different models capable of score-informed performance assessment. These are (i) a convolutional neural network that utilizes a simple time-series input comprising of aligned pitch contours and score, (ii) a joint embedding model which learns a joint latent space for pitch contours and scores, and (iii) a distance matrix-based convolutional neural network which utilizes patterns in the distance matrix between pitch contours and musical score to predict assessment ratings. Our results provide insights into the suitability of different architectures and input representations and demonstrate the benefits of score-informed models as compared to score-independent models.

READ FULL TEXT

page 1

page 2

page 3

page 4

05/28/2019

Demonstration of PerformanceNet: A Convolutional Neural Network Model for Score-to-Audio Music Generation

We present in this paper PerformacnceNet, a neural network model we prop...
07/02/2019

Learning to Traverse Latent Spaces for Musical Score Inpainting

Music Inpainting is the task of filling in missing or lost information i...
08/03/2021

Improving Music Performance Assessment with Contrastive Learning

Several automatic approaches for objective music performance assessment ...
07/12/2017

Score-informed syllable segmentation for a cappella singing voice with convolutional neural networks

This paper introduces a new score-informed method for the segmentation o...
06/03/2019

Evaluating Non-aligned Musical Score Transcriptions with MV2H

The original MV2H metric was designed to evaluate systems which transcri...
02/12/2020

Deep Autotuner: a Pitch Correcting Network for Singing Performances

We introduce a data-driven approach to automatic pitch correction of sol...
08/16/2018

Genre-Agnostic Key Classification With Convolutional Neural Networks

We propose modifications to the model structure and training procedure t...