Generating lyrics with variational autoencoder and multi-modal artist embeddings

12/20/2018
by   Olga Vechtomova, et al.
0

We present a system for generating song lyrics lines conditioned on the style of a specified artist. The system uses a variational autoencoder with artist embeddings. We propose the pre-training of artist embeddings with the representations learned by a CNN classifier, which is trained to predict artists based on MEL spectrograms of their song clips. This work is the first step towards combining audio and text modalities of songs for generating lyrics conditioned on the artist's style. Our preliminary results suggest that there is a benefit in initializing artists' embeddings with the representations learned by a spectrogram classifier.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/16/2020

Conditioned Variational Autoencoder for top-N item recommendation

In this paper, we propose a Conditioned Variational Autoencoder to impro...
research
09/30/2020

Generation of lyrics lines conditioned on music audio clips

We present a system for generating novel lyrics lines conditioned on mus...
research
05/03/2021

Fusing multimodal neuroimaging data with a variational autoencoder

Neuroimaging studies often involve the collection of multiple data modal...
research
09/01/2020

Text and Style Conditioned GAN for Generation of Offline Handwriting Lines

This paper presents a GAN for generating images of handwritten lines con...
research
11/01/2019

A Perceived Environment Design using a Multi-Modal Variational Autoencoder for learning Active-Sensing

This contribution comprises the interplay between a multi-modal variatio...
research
11/21/2017

Generating Thematic Chinese Poetry with Conditional Variational Autoencoder

Computer poetry generation is our first step towards computer writing. W...
research
01/28/2021

VRoC: Variational Autoencoder-aided Multi-task Rumor Classifier Based on Text

Social media became popular and percolated almost all aspects of our dai...

Please sign up or login with your details

Forgot password? Click here to reset