Vertical-Horizontal Structured Attention for Generating Music with Chords

11/18/2020
by   Yizhou Zhao, et al.
0

In this paper, we propose a lightweight music-generating model based on variational autoencoder (VAE) with structured attention. Generating music is different from generating text because the melodies with chords give listeners distinguished polyphonic feelings. In a piece of music, a chord consisting of multiple notes comes from either the mixture of multiple instruments or the combination of multiple keys of a single instrument. We focus our study on the latter. Our model captures not only the temporal relations along time but the structure relations between keys. Experimental results show that our model has a better performance than baseline MusicVAE in capturing notes in a chord. Besides, our method accords with music theory since it maintains the configuration of the circle of fifths, distinguishes major and minor keys from interval vectors, and manifests meaningful structures between music phrases.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/19/2017

A Classifying Variational Autoencoder with Application to Polyphonic Music Generation

The variational autoencoder (VAE) is a popular probabilistic generative ...
research
10/13/2020

A variational autoencoder for music generation controlled by tonal tension

Many of the music generation systems based on neural networks are fully ...
research
06/19/2023

Multitrack Music Transcription with a Time-Frequency Perceiver

Multitrack music transcription aims to transcribe a music audio input in...
research
07/21/2021

Melody Structure Transfer Network: Generating Music with Separable Self-Attention

Symbolic music generation has attracted increasing attention, while most...
research
07/14/2022

Multitrack Music Transformer: Learning Long-Term Dependencies in Music with Diverse Instruments

Existing approaches for generating multitrack music with transformer mod...
research
09/05/2022

Instrument Separation of Symbolic Music by Explicitly Guided Diffusion Model

Similar to colorization in computer vision, instrument separation is to ...
research
07/25/2011

An end-to-end machine learning system for harmonic analysis of music

We present a new system for simultaneous estimation of keys, chords, and...

Please sign up or login with your details

Forgot password? Click here to reset