Music Interpretation Analysis. A Multimodal Approach To Score-Informed Resynthesis of Piano Recordings

05/02/2022
by   Federico Simonetta, et al.
0

This Thesis discusses the development of technologies for the automatic resynthesis of music recordings using digital synthesizers. First, the main issue is identified in the understanding of how Music Information Processing (MIP) methods can take into consideration the influence of the acoustic context on the music performance. For this, a novel conceptual and mathematical framework named "Music Interpretation Analysis" (MIA) is presented. In the proposed framework, a distinction is made between the "performance" - the physical action of playing - and the "interpretation" - the action that the performer wishes to achieve. Second, the Thesis describes further works aiming at the democratization of music production tools via automatic resynthesis: 1) it elaborates software and file formats for historical music archiving and multimodal machine-learning datasets; 2) it explores and extends MIP technologies; 3) it presents the mathematical foundations of the MIA framework and shows preliminary evaluations to demonstrate the effectiveness of the approach

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/24/2022

A Perceptual Measure for Evaluating the Resynthesis of Automatic Music Transcriptions

This study focuses on the perception of music performances when contextu...
research
02/14/2019

Multimodal music information processing and retrieval: survey and future challenges

Towards improving the performance in various music information processin...
research
09/23/2019

Automatic Lyrics Alignment and Transcription in Polyphonic Music: Does Background Music Help?

Background music affects lyrics intelligibility of singing vocals in a m...
research
10/02/2022

Music-to-Text Synaesthesia: Generating Descriptive Text from Music Recordings

In this paper, we consider a novel research problem, music-to-text synae...
research
03/15/2023

PHONEix: Acoustic Feature Processing Strategy for Enhanced Singing Pronunciation with Phoneme Distribution Predictor

Singing voice synthesis (SVS), as a specific task for generating the voc...
research
05/15/2021

Analyzing Images for Music Recommendation

Experiencing images with suitable music can greatly enrich the overall u...
research
03/04/2020

ASMD: an automatic framework for compiling multimodal datasets

This paper describes an open-source Python framework for handling datase...

Please sign up or login with your details

Forgot password? Click here to reset