LPCNet: Improving Neural Speech Synthesis Through Linear Prediction

10/28/2018
by   Jean-Marc Valin, et al.
0

Neural speech synthesis models have recently demonstrated the ability to synthesize high quality speech for text-to-speech and compression applications. These new models often require powerful GPUs to achieve real-time operation, so being able to reduce their complexity would open the way for many new applications. We propose LPCNet, a WaveRNN variant that combines linear prediction with recurrent neural networks to significantly improve the efficiency of speech synthesis. We demonstrate that LPCNet can achieve significantly higher quality than WaveRNN for the same network size and that high quality LPCNet speech synthesis is achievable with a complexity under 3 GFLOPS. This makes it easier to deploy neural synthesis applications on lower-power devices, such as embedded systems and mobile phones.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/22/2022

Neural Speech Synthesis on a Shoestring: Improving the Efficiency of LPCNet

Neural speech synthesis models can synthesize high quality speech but ty...
research
03/28/2019

A Real-Time Wideband Neural Vocoder at 1.6 kb/s Using LPCNet

Neural speech synthesis algorithms are a promising new approach for codi...
research
09/22/2012

Using multimodal speech production data to evaluate articulatory animation for audiovisual speech synthesis

The importance of modeling speech articulation for high-quality audiovis...
research
05/02/2019

High quality, lightweight and adaptable TTS using LPCNet

We present a lightweight adaptable neural TTS system with high quality o...
research
09/17/2021

On-device neural speech synthesis

Recent advances in text-to-speech (TTS) synthesis, such as Tacotron and ...
research
03/06/2022

Variational Auto-Encoder based Mandarin Speech Cloning

Speech cloning technology is becoming more sophisticated thanks to the a...
research
11/11/2019

Feedback Recurrent AutoEncoder

In this work, we propose a new recurrent autoencoder architecture, terme...

Please sign up or login with your details

Forgot password? Click here to reset