DeepAI AI Chat
Log In Sign Up

Vector Quantized Contrastive Predictive Coding for Template-based Music Generation

04/21/2020
by   Gaëtan Hadjeres, et al.
Sony
0

In this work, we propose a flexible method for generating variations of discrete sequences in which tokens can be grouped into basic units, like sentences in a text or bars in music. More precisely, given a template sequence, we aim at producing novel sequences sharing perceptible similarities with the original template without relying on any annotation; so our problem of generating variations is intimately linked to the problem of learning relevant high-level representations without supervision. Our contribution is two-fold: First, we propose a self-supervised encoding technique, named Vector Quantized Contrastive Predictive Coding which allows to learn a meaningful assignment of the basic units over a discrete set of codes, together with mechanisms allowing to control the information content of these learnt discrete representations. Secondly, we show how these compressed representations can be used to generate variations of a template sequence by using an appropriate attention pattern in the Transformer architecture. We illustrate our approach on the corpus of J.S. Bach chorales where we discuss the musical meaning of the learnt discrete codes and show that our proposed method allows to generate coherent and high-quality variations of a given template.

READ FULL TEXT

page 1

page 2

page 3

page 4

05/17/2020

Vector-Quantized Autoregressive Predictive Coding

Autoregressive Predictive Coding (APC), as a self-supervised objective, ...
02/11/2022

MusIAC: An extensible generative framework for Music Infilling Applications with multi-level Control

We present a novel music generation framework for music infilling, with ...
04/24/2021

Aligned Contrastive Predictive Coding

We investigate the possibility of forcing a self-supervised model traine...
08/11/2022

Symbolic Music Loop Generation with Neural Discrete Representations

Since most of music has repetitive structures from motifs to phrases, re...
11/26/2021

Learning source-aware representations of music in a discrete latent space

In recent years, neural network based methods have been proposed as a me...
08/08/2022

Generating Coherent Narratives by Learning Dynamic and Discrete Entity States with a Contrastive Framework

Despite advances in generating fluent texts, existing pretraining models...
09/27/2022

Computing Melodic Templates in Oral Music Traditions

The term melodic template or skeleton refers to a basic melody which is ...