RL-Duet: Online Music Accompaniment Generation Using Deep Reinforcement Learning

by   Nan Jiang, et al.
Tsinghua University
University of Rochester

This paper presents a deep reinforcement learning algorithm for online accompaniment generation, with potential for real-time interactive human-machine duet improvisation. Different from offline music generation and harmonization, online music accompaniment requires the algorithm to respond to human input and generate the machine counterpart in a sequential order. We cast this as a reinforcement learning problem, where the generation agent learns a policy to generate a musical note (action) based on previously generated context (state). The key of this algorithm is the well-functioning reward model. Instead of defining it using music composition rules, we learn this model from monophonic and polyphonic training data. This model considers the compatibility of the machine-generated note with both the machine-generated context and the human-generated context. Experiments show that this algorithm is able to respond to the human part and generate a melodic, harmonic and diverse machine part. Subjective evaluations on preferences show that the proposed algorithm generates music pieces of higher quality than the baseline method.


Bach2Bach: Generating Music Using A Deep Reinforcement Learning Approach

A model of music needs to have the ability to recall past details and ha...

Automatic, Personalized, and Flexible Playlist Generation using Reinforcement Learning

Songs can be well arranged by professional music curators to form a rive...

RLSS: A Deep Reinforcement Learning Algorithm for Sequential Scene Generation

We present RLSS: a reinforcement learning algorithm for sequential scene...

Clickbait? Sensational Headline Generation with Auto-tuned Reinforcement Learning

Sensational headlines are headlines that capture people's attention and ...

Generate and Revise: Reinforcement Learning in Neural Poetry

Writers, poets, singers usually do not create their compositions in just...

Melody Generation using an Interactive Evolutionary Algorithm

Music generation with the aid of computers has been recently grabbed the...

A Framework for Automated Pop-song Melody Generation with Piano Accompaniment Arrangement

We contribute a pop-song automation framework for lead melody generation...

Please sign up or login with your details

Forgot password? Click here to reset