AccoMontage: Accompaniment Arrangement via Phrase Selection and Style Transfer

08/25/2021
by   Jingwei Zhao, et al.
0

Accompaniment arrangement is a difficult music generation task involving intertwined constraints of melody, harmony, texture, and music structure. Existing models are not yet able to capture all these constraints effectively, especially for long-term music generation. To address this problem, we propose AccoMontage, an accompaniment arrangement system for whole pieces of music through unifying phrase selection and neural style transfer. We focus on generating piano accompaniments for folk/pop songs based on a lead sheet (i.e., melody with chord progression). Specifically, AccoMontage first retrieves phrase montages from a database while recombining them structurally using dynamic programming. Second, chords of the retrieved phrases are manipulated to match the lead sheet via style transfer. Lastly, the system offers controls over the generation process. In contrast to pure learning-based approaches, AccoMontage introduces a novel hybrid pathway, in which rule-based optimization and deep learning are both leveraged to complement each other for high-quality generation. Experiments show that our model generates well-structured accompaniment with delicate texture, significantly outperforming the baselines.

READ FULL TEXT

page 5

page 6

research
01/21/2022

Can Machines Generate Personalized Music? A Hybrid Favorite-aware Method for User Preference Music Transfer

User preference music transfer (UPMT) is a new problem in music style tr...
research
08/17/2020

Learning Interpretable Representation for Controllable Polyphonic Music Generation

While deep generative models have become the leading methods for algorit...
research
09/01/2022

AccoMontage2: A Complete Harmonization and Accompaniment Arrangement System

We propose AccoMontage2, a system capable of doing full-length song harm...
research
03/19/2018

Music Style Transfer: A Position Paper

Led by the success of neural style transfer on visual arts, there has be...
research
12/28/2018

A Framework for Automated Pop-song Melody Generation with Piano Accompaniment Arrangement

We contribute a pop-song automation framework for lead melody generation...
research
03/19/2018

Music Style Transfer Issues: A Position Paper

Led by the success of neural style transfer on visual arts, there has be...
research
09/27/2018

A Lightweight Music Texture Transfer System

Deep learning researches on the transformation problems for image and te...

Please sign up or login with your details

Forgot password? Click here to reset