Applying Feature Underspecified Lexicon Phonological Features in Multilingual Text-to-Speech

04/14/2022
by   Cong Zhang, et al.
0

This study investigates whether the phonological features derived from the Featurally Underspecified Lexicon model can be applied in text-to-speech systems to generate native and non-native speech in English and Mandarin. We present a mapping of ARPABET/pinyin to SAMPA/SAMPA-SC and then to phonological features. This mapping was tested for whether it could lead to the successful generation of native, non-native, and code-switched speech in the two languages. We ran two experiments, one with a small dataset and one with a larger dataset. The results supported that phonological features could be used as a feasible input system for languages in or not in the train data, although further investigation is needed to improve model performance. The results lend support to FUL by presenting successfully synthesised output, and by having the output carrying a source-language accent when synthesising a language not in the training data. The TTS process stimulated human second language acquisition process and thus also confirm FUL's ability to account for acquisition.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/07/2021

Applying Phonological Features in Multilingual Text-To-Speech

This study investigates whether phonological features can be applied in ...
research
05/11/2020

Luganda Text-to-Speech Machine

In Uganda, Luganda is the most spoken native language. It is used for co...
research
05/31/2023

SLABERT Talk Pretty One Day: Modeling Second Language Acquisition with BERT

Second language acquisition (SLA) research has extensively studied cross...
research
03/31/2022

A Baseline Readability Model for Cebuano

In this study, we developed the first baseline readability model for the...
research
05/31/2022

Predicting non-native speech perception using the Perceptual Assimilation Model and state-of-the-art acoustic models

Our native language influences the way we perceive speech sounds, affect...
research
01/31/2019

Rhythm Zone Theory: Speech Rhythms are Physical after all

Speech rhythms have been dealt with in three main ways: from the introsp...
research
02/03/2023

Around the world in 60 words: A generative vocabulary test for online research

Conducting experiments with diverse participants in their native languag...

Please sign up or login with your details

Forgot password? Click here to reset