WaveNet: A Generative Model for Raw Audio

09/12/2016
by   Aaron van den Oord, et al.
0

This paper introduces WaveNet, a deep neural network for generating raw audio waveforms. The model is fully probabilistic and autoregressive, with the predictive distribution for each audio sample conditioned on all previous ones; nonetheless we show that it can be efficiently trained on data with tens of thousands of samples per second of audio. When applied to text-to-speech, it yields state-of-the-art performance, with human listeners rating it as significantly more natural sounding than the best parametric and concatenative systems for both English and Mandarin. A single WaveNet can capture the characteristics of many different speakers with equal fidelity, and can switch between them by conditioning on the speaker identity. When trained to model music, we find that it generates novel and often highly realistic musical fragments. We also show that it can be employed as a discriminative model, returning promising results for phoneme recognition.

READ FULL TEXT

page 1

page 7

research
04/30/2020

Jukebox: A Generative Model for Music

We introduce Jukebox, a model that generates music with singing in the r...
research
07/24/2018

A Hybrid of Deep Audio Feature and i-vector for Artist Recognition

Artist recognition is a task of modeling the artist's musical style. Thi...
research
11/26/2019

SchrödingeRNN: Generative Modeling of Raw Audio as a Continuously Observed Quantum State

We introduce SchrödingeRNN, a quantum inspired generative model for raw ...
research
06/04/2019

MelNet: A Generative Model for Audio in the Frequency Domain

Capturing high-level structure in audio waveforms is challenging because...
research
06/30/2022

R-MelNet: Reduced Mel-Spectral Modeling for Neural TTS

This paper introduces R-MelNet, a two-part autoregressive architecture w...
research
06/13/2020

GIPFA: Generating IPA Pronunciation from Audio

Transcribing spoken audio samples into International Phonetic Alphabet (...
research
06/30/2021

A Generative Model for Raw Audio Using Transformer Architectures

This paper proposes a novel way of doing audio synthesis at the waveform...

Please sign up or login with your details

Forgot password? Click here to reset