AI Song Contest: Human-AI Co-Creation in Songwriting

by   Cheng-Zhi Anna Huang, et al.

Machine learning is challenging the way we make music. Although research in deep generative models has dramatically improved the capability and fluency of music models, recent work has shown that it can be challenging for humans to partner with this new class of algorithms. In this paper, we present findings on what 13 musician/developer teams, a total of 61 users, needed when co-creating a song with AI, the challenges they faced, and how they leveraged and repurposed existing characteristics of AI to overcome some of these challenges. Many teams adopted modular approaches, such as independently running multiple smaller models that align with the musical building blocks of a song, before re-combining their results. As ML models are not easily steerable, teams also generated massive numbers of samples and curated them post-hoc, or used a range of strategies to direct the generation, or algorithmically ranked the samples. Ultimately, teams not only had to manage the "flare and focus" aspects of the creative process, but also juggle them with a parallel process of exploring and curating multiple ML models and outputs. These findings reflect a need to design machine learning-powered music interfaces that are more decomposable, steerable, interpretable, and adaptive, which in return will enable artists to more effectively explore how AI can extend their personal expression.



There are no comments yet.


page 1

page 2

page 3

page 4


Expressive Communication: A Common Framework for Evaluating Developments in Generative Models and Steering Interfaces

There is an increasing interest from ML and HCI communities in empowerin...

Symphony: Composing Interactive Interfaces for Machine Learning

Interfaces for machine learning (ML), information and visualizations abo...

Friend, Collaborator, Student, Manager: How Design of an AI-Driven Game Level Editor Affects Creators

Machine learning advances have afforded an increase in algorithms capabl...

SophiaPop: Experiments in Human-AI Collaboration on Popular Music

A diverse team of engineers, artists, and algorithms, collaborated to cr...

Music Classification in MIDI Format based on LSTM Mdel

Music classification between music made by AI or human composers can be ...

Assisted music creation with Flow Machines: towards new categories of new

This chapter reflects on about 10 years of research in AI- assisted musi...

LiftTiles: Constructive Building Blocks for Prototyping Room-scale Shape-changing Interfaces

Large-scale shape-changing interfaces have great potential, but creating...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.