Score and Lyrics-Free Singing Voice Generation

12/26/2019
by   Jen-Yu Liu, et al.
0

Generative models for singing voice have been mostly concerned with the task of "singing voice synthesis," i.e., to produce singing voice waveforms given musical scores and text lyrics. In this work, we explore a novel yet challenging alternative: singing voice generation without pre-assigned scores and lyrics, in both training and inference time. In particular, we propose three either unconditioned or weakly conditioned singing voice generation schemes. We outline the associated challenges and propose a pipeline to tackle these new tasks. This involves the development of source separation and transcription models for data preparation, adversarial networks for audio generation, and customized metrics for evaluation.

READ FULL TEXT

page 15

page 16

research
04/20/2021

A cappella: Audio-visual Singing Voice Separation

Music source separation can be interpreted as the estimation of the cons...
research
02/27/2023

Renaissance canons with asymmetric schemes

By a "scheme" of a musical canon, we mean the order of voice entry with ...
research
10/23/2020

Toward Expressive Singing Voice Correction: On Perceptual Validity of Evaluation Metrics for Vocal Melody Extraction

Singing voice correction (SVC) is an appealing application for amateur s...
research
09/18/2019

Bayesian Strategies for Likelihood Ratio Computation in Forensic Voice Comparison with Automatic Systems

This paper explores several strategies for Forensic Voice Comparison (FV...
research
06/27/2021

AI based Presentation Creator With Customized Audio Content Delivery

In this paper, we propose an architecture to solve a novel problem state...
research
10/22/2019

Toward estimating personal well-being using voice

Estimating personal well-being draws increasing attention particularly f...
research
05/03/2018

Single-Channel Blind Source Separation for Singing Voice Detection: A Comparative Study

We propose a novel unsupervised singing voice detection method which use...

Please sign up or login with your details

Forgot password? Click here to reset