Evaluating Features and Metrics for High-Quality Simulation of Early Vocal Learning of Vowels

05/20/2020
by   Branislav Gerazov, et al.
0

The way infants use auditory cues to learn to speak despite the acoustic mismatch of their vocal apparatus is a hot topic of scientific debate. The simulation of early vocal learning using articulatory speech synthesis offers a way towards gaining a deeper understanding of this process. One of the crucial parameters in these simulations is the choice of features and a metric to evaluate the acoustic error between the synthesised sound and the reference target. We contribute with evaluating the performance of a set of 40 feature-metric combinations for the task of optimising the production of static vowels with a high-quality articulatory synthesiser. Towards this end we assess the usability of formant error and the projection of the feature-metric error surface in the normalised F1-F2 formant space. We show that this approach can be used to evaluate the impact of features and metrics and also to offer insight to perceptual results.

READ FULL TEXT
research
02/19/2019

P-Reverb: Perceptual Characterization of Early and Late Reflections for Auditory Displays

We introduce a novel, perceptually derived metric (P-Reverb) that relate...
research
04/03/2022

On incorporating social speaker characteristics in synthetic speech

In our previous work, we derived the acoustic features, that contribute ...
research
09/22/2012

Using multimodal speech production data to evaluate articulatory animation for audiovisual speech synthesis

The importance of modeling speech articulation for high-quality audiovis...
research
06/29/2023

On the relevance of acoustic measurements for creating realistic virtual acoustic environments

Geometrical approaches for room acoustics simulation have the advantage ...
research
05/19/2022

Evaluating Subtitle Segmentation for End-to-end Generation Systems

Subtitles appear on screen as short pieces of text, segmented based on f...

Please sign up or login with your details

Forgot password? Click here to reset