DeepAI AI Chat
Log In Sign Up

Dr.VOT : Measuring Positive and Negative Voice Onset Time in the Wild

by   Yosi Shrem, et al.

Voice Onset Time (VOT), a key measurement of speech for basic research and applied medical studies, is the time between the onset of a stop burst and the onset of voicing. When the voicing onset precedes burst onset the VOT is negative; if voicing onset follows the burst, it is positive. In this work, we present a deep-learning model for accurate and reliable measurement of VOT in naturalistic speech. The proposed system addresses two critical issues: it can measure positive and negative VOT equally well, and it is trained to be robust to variation across annotations. Our approach is based on the structured prediction framework, where the feature functions are defined to be RNNs. These learn to capture segmental variation in the signal. Results suggest that our method substantially improves over the current state-of-the-art. In contrast to previous work, our Deep and Robust VOT annotator, Dr.VOT, can successfully estimate negative VOTs while maintaining state-of-the-art performance on positive VOTs. This high level of performance generalizes to new corpora without further retraining. Index Terms: structured prediction, multi-task learning, adversarial training, recurrent neural networks, sequence segmentation.


page 1

page 2

page 3

page 4


Sequence Segmentation Using Joint RNN and Structured Prediction Models

We describe and analyze a simple and effective algorithm for sequence se...

Prototypical Networks for Multi-Label Learning

We propose to address multi-label learning by jointly estimating the dis...

Neural Disease Named Entity Extraction with Character-based BiLSTM+CRF in Japanese Medical Text

We propose an 'end-to-end' character-based recurrent neural network that...

DR-Label: Improving GNN Models for Catalysis Systems by Label Deconstruction and Reconstruction

Attaining the equilibrium state of a catalyst-adsorbate system is key to...

Learning Human Cognitive Appraisal Through Reinforcement Memory Unit

We propose a novel memory-enhancing mechanism for recurrent neural netwo...

Automatic Measurement of Pre-aspiration

Pre-aspiration is defined as the period of glottal friction occurring in...

Towards a Mathematical Foundation of Immunology and Amino Acid Chains

We attempt to set a mathematical foundation of immunology and amino acid...