DeepAI AI Chat
Log In Sign Up

Outer-Product Hidden Markov Model and Polyphonic MIDI Score Following

by   Eita Nakamura, et al.

We present a polyphonic MIDI score-following algorithm capable of following performances with arbitrary repeats and skips, based on a probabilistic model of musical performances. It is attractive in practical applications of score following to handle repeats and skips which may be made arbitrarily during performances, but the algorithms previously described in the literature cannot be applied to scores of practical length due to problems with large computational complexity. We propose a new type of hidden Markov model (HMM) as a performance model which can describe arbitrary repeats and skips including performer tendencies on distributed score positions before and after them, and derive an efficient score-following algorithm that reduces computational complexity without pruning. A theoretical discussion on how much such information on performer tendencies improves the score-following results is given. The proposed score-following algorithm also admits performance mistakes and is demonstrated to be effective in practical situations by carrying out evaluations with human performances. The proposed HMM is potentially valuable for other topics in information processing and we also provide a detailed description of inference algorithms.


page 1

page 2

page 3

page 4


Automatic Music Accompanist

Automatic musical accompaniment is where a human musician is accompanied...

A Stochastic Temporal Model of Polyphonic MIDI Performance with Ornaments

We study indeterminacies in realization of ornaments and how they can be...

Online Learning in Discrete Hidden Markov Models

We present and analyse three online algorithms for learning in discrete ...

The match file format: Encoding Alignments between Scores and Performances

This paper presents the specifications of match: a file format that exte...

Temporal Parallelization of Inference in Hidden Markov Models

This paper presents algorithms for parallelization of inference in hidde...

Audio-Conditioned U-Net for Position Estimation in Full Sheet Images

The goal of score following is to track a musical performance, usually i...

Rhythm Transcription of Polyphonic Piano Music Based on Merged-Output HMM for Multiple Voices

In a recent conference paper, we have reported a rhythm transcription me...