Generative Melody Composition with Human-in-the-Loop Bayesian Optimization

10/07/2020
by   Yijun Zhou, et al.
0

Deep generative models allow even novice composers to generate various melodies by sampling latent vectors. However, finding the desired melody is challenging since the latent space is unintuitive and high-dimensional. In this work, we present an interactive system that supports generative melody composition with human-in-the-loop Bayesian optimization (BO). This system takes a mixed-initiative approach; the system generates candidate melodies to evaluate, and the user evaluates them and provides preferential feedback (i.e., picking the best melody among the candidates) to the system. This process is iteratively performed based on BO techniques until the user finds the desired melody. We conducted a pilot study using our prototype system, suggesting the potential of this approach.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/28/2022

Local Latent Space Bayesian Optimization over Structured Inputs

Bayesian optimization over the latent spaces of deep autoencoder models ...
research
06/24/2019

Interactive Subspace Exploration on Generative Image Modelling

Generative image modeling techniques such as GAN demonstrate highly conv...
research
04/21/2021

AdaptiFont: Increasing Individuals' Reading Speed with a Generative Font Model and Bayesian Optimization

Digital text has become one of the primary ways of exchanging knowledge,...
research
09/12/2019

Closed-loop Model Selection for Kernel-based Models using Bayesian Optimization

Kernel-based nonparametric models have become very attractive for model-...
research
02/27/2020

Deep Meditations: Controlled navigation of latent space

We introduce a method which allows users to creatively explore and navig...
research
05/18/2023

Autonomous sputter synthesis of thin film nitrides with composition controlled by Bayesian optimization of optical plasma emission

Autonomous experimentation has emerged as an efficient approach to accel...
research
06/16/2023

Human-in-the-Loop Optimization for Deep Stimulus Encoding in Visual Prostheses

Neuroprostheses show potential in restoring lost sensory function and en...

Please sign up or login with your details

Forgot password? Click here to reset