Harmonization and Evaluation; Tweaking the Parameters on Human Listeners

08/31/2022
by   Filippo Carnovalini, et al.
0

Kansei models were used to study the connotative meaning of music. In multimedia and mixed reality, automatically generated melodies are increasingly being used. It is important to consider whether and what feelings are communicated by this music. Evaluation of computer-generated melodies is not a trivial task. Considered the difficulty of defining useful quantitative metrics of the quality of a generated musical piece, researchers often resort to human evaluation. In these evaluations, often the judges are required to evaluate a set of generated pieces along with some benchmark pieces. The latter are often composed by humans. While this kind of evaluation is relatively common, it is known that care should be taken when designing the experiment, as humans can be influenced by a variety of factors. In this paper, we examine the impact of the presence of harmony in audio files that judges must evaluate, to see whether having an accompaniment can change the evaluation of generated melodies. To do so, we generate melodies with two different algorithms and harmonize them with an automatic tool that we designed for this experiment, and ask more than sixty participants to evaluate the melodies. By using statistical analyses, we show harmonization does impact the evaluation process, by emphasizing the differences among judgements.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/07/2020

A novel dataset for the identification of computer generated melodies in the CSMT challenge

In this paper, the dataset used for the data challenge organised by Conf...
research
08/26/2023

A Comprehensive Survey for Evaluation Methodologies of AI-Generated Music

In recent years, AI-generated music has made significant progress, with ...
research
10/16/2019

A Study of Annotation and Alignment Accuracy for Performance Comparison in Complex Orchestral Music

Quantitative analysis of commonalities and differences between recorded ...
research
12/31/2021

Evaluating Deep Music Generation Methods Using Data Augmentation

Despite advances in deep algorithmic music generation, evaluation of gen...
research
06/23/2020

Bach or Mock? A Grading Function for Chorales in the Style of J.S. Bach

Deep generative systems that learn probabilistic models from a corpus of...
research
10/16/2020

Melody Classifier with Stacked-LSTM

Attempts to use generative models for music generation have been common ...
research
08/31/2022

A Real-Time Tempo and Meter Tracking System for Rhythmic Improvis

Music is a form of expression that often requires interaction between pl...

Please sign up or login with your details

Forgot password? Click here to reset