Melody-Conditioned Lyrics Generation with SeqGANs

by   Yihao Chen, et al.

Automatic lyrics generation has received attention from both music and AI communities for years. Early rule-based approaches have —due to increases in computational power and evolution in data-driven models— mostly been replaced with deep-learning-based systems. Many existing approaches, however, either rely heavily on prior knowledge in music and lyrics writing or oversimplify the task by largely discarding melodic information and its relationship with the text. We propose an end-to-end melody-conditioned lyrics generation system based on Sequence Generative Adversarial Networks (SeqGAN), which generates a line of lyrics given the corresponding melody as the input. Furthermore, we investigate the performance of the generator with an additional input condition: the theme or overarching topic of the lyrics to be generated. We show that the input conditions have no negative impact on the evaluation metrics while enabling the network to produce more meaningful results.


WuYun: Exploring hierarchical skeleton-guided melody generation using knowledge-enhanced deep learning

Although deep learning has revolutionized music generation, existing met...

Deep Learning Techniques for Music Generation - A Survey

This book is a survey and an analysis of different ways of using deep le...

Generative Deep Learning for Virtuosic Classical Music: Generative Adversarial Networks as Renowned Composers

Current AI-generated music lacks fundamental principles of good composit...

Text2Colors: Guiding Image Colorization through Text-Driven Palette Generation

In this paper, we propose a novel approach to generate multiple color pa...

ReLyMe: Improving Lyric-to-Melody Generation by Incorporating Lyric-Melody Relationships

Lyric-to-melody generation, which generates melody according to given ly...

Conditional LSTM-GAN for Melody Generation from Lyrics

Melody generation from lyrics has been a challenging research issue in t...

Generating Coherent Drum Accompaniment With Fills And Improvisations

Creating a complex work of art like music necessitates profound creativi...

Please sign up or login with your details

Forgot password? Click here to reset