research
∙
09/13/2023
Enhancing Child Vocalization Classification in Multi-Channel Child-Adult Conversations Through Wav2vec2 Children ASR Features
Autism Spectrum Disorder (ASD) is a neurodevelopmental disorder that oft...
share
research
∙
08/16/2023
Mitigating the Exposure Bias in Sentence-Level Grapheme-to-Phoneme (G2P) Transduction
Text-to-Text Transfer Transformer (T5) has recently been considered for ...
research
∙
06/27/2023
Classification of Infant Sleep/Wake States: Cross-Attention among Large Scale Pretrained Transformer Networks using Audio, ECG, and IMU Data
Infant sleep is critical to brain and behavioral development. Prior stud...
research
∙
06/09/2023
A Theory of Unsupervised Speech Recognition
Unsupervised speech recognition (ASR-U) is the problem of learning autom...
research
∙
05/25/2023
INTapt: Information-Theoretic Adversarial Prompt Tuning for Enhanced Non-Native Speech Recognition
Automatic Speech Recognition (ASR) systems have attained unprecedented p...
research
∙
05/21/2023
Towards Robust Family-Infant Audio Analysis Based on Unsupervised Pretraining of Wav2vec 2.0 on Large-Scale Unlabeled Family Audio
To perform automatic family audio analysis, past studies have collected ...
research
∙
12/14/2022
SMSMix: Sense-Maintained Sentence Mixup for Word Sense Disambiguation
Word Sense Disambiguation (WSD) is an NLP task aimed at determining the ...
research
∙
07/09/2022
Dual-path Attention is All You Need for Audio-Visual Speech Extraction
Audio-visual target speech extraction, which aims to extract a certain s...
research
∙
04/07/2022
Equivariance Discovery by Learned Parameter-Sharing
Designing equivariance as an inductive bias into deep-nets has been a pr...
research
∙
03/29/2022
Visualizations of Complex Sequences of Family-Infant Vocalizations Using Bag-of-Audio-Words Approach Based on Wav2vec 2.0 Features
In the U.S., approximately 15-17 to have at least one diagnosed mental, ...
research
∙
01/26/2022
Discovering Phonetic Inventories with Crosslingual Automatic Speech Recognition
The high cost of data acquisition makes Automatic Speech Recognition (AS...
research
∙
09/23/2021
Fast and Efficient MMD-based Fair PCA via Optimization over Stiefel Manifold
This paper defines fair principal component analysis (PCA) as minimizing...
research
∙
06/16/2021
Global Rhythm Style Transfer Without Text Transcriptions
Prosody plays an important role in characterizing the style of a speaker...
research
∙
12/31/2020
Seeing is Knowing! Fact-based Visual Question Answering using Knowledge Graph Embeddings
Fact-based Visual Question Answering (FVQA), a challenging variant of VQ...
research
∙
11/24/2020
Multi-Decoder DPRNN: High Accuracy Source Counting and Separation
We propose an end-to-end trainable approach to single-channel speech sep...
research
∙
11/23/2020
Interpretable Visual Reasoning via Induced Symbolic Space
We study the problem of concept induction in visual reasoning, i.e., ide...
research
∙
11/05/2020
A Comparison Study on Infant-Parent Voice Diarization
We design a framework for studying prelinguistic child voicefrom 3 to 24...
research
∙
10/23/2020
Show and Speak: Directly Synthesize Spoken Description of Images
This paper proposes a new model, referred to as the show and speak (SAS)...
research
∙
10/22/2020
How Phonotactics Affect Multilingual and Zero-shot ASR Performance
The idea of combining multiple languages' recordings to train a single a...
research
∙
09/17/2020
Utterance-level Intent Recognition from Keywords
This paper focuses on wake on intent (WOI) techniques for platforms with...
research
∙
08/08/2020
Deep F-measure Maximization for End-to-End Speech Understanding
Spoken language understanding (SLU) datasets, like many other machine le...
research
∙
07/31/2020
Evaluating Automatically Generated Phoneme Captions for Images
Image2Speech is the relatively new task of generating a spoken descripti...
research
∙
07/28/2020
Autosegmental Neural Nets: Should Phones and Tones be Synchronous or Asynchronous?
Phones, the segmental units of the International Phonetic Alphabet (IPA)...
research
∙
05/22/2020
Identify Speakers in Cocktail Parties with End-to-End Attention
In scenarios where multiple speakers talk at the same time, it is import...
research
∙
05/16/2020
That Sounds Familiar: an Analysis of Phonetic Representations Transfer Across Languages
Only a handful of the world's languages are abundant with the resources ...
research
∙
05/12/2020
Automatic Estimation of Inteligibility Measure for Consonants in Speech
In this article, we provide a model to estimate a real-valued measure of...
research
∙
04/23/2020
Unsupervised Speech Decomposition via Triple Information Bottleneck
Speech information can be roughly decomposed into four components: langu...
research
∙
04/15/2020
F0-consistent many-to-many non-parallel voice conversion via conditional autoencoder
Non-parallel many-to-many voice conversion remains an interesting but ch...
research
∙
09/16/2019
Fast transcription of speech in low-resource languages
We present software that, in only a few hours, transcribes forty hours o...
research
∙
05/14/2019
Zero-Shot Voice Style Transfer with Only Autoencoder Loss
Non-parallel many-to-many voice conversion, as well as zero-shot voice c...
research
∙
05/14/2019
AUTOVC: Zero-Shot Voice Style Transfer with Only Autoencoder Loss
Non-parallel many-to-many voice conversion, as well as zero-shot voice c...
research
∙
11/05/2018
When CTC Training Meets Acoustic Landmarks
Connectionist temporal classification (CTC) training criterion provides ...
research
∙
05/15/2018
Improved ASR for Under-Resourced Languages Through Multi-Task Learning with Acoustic Landmarks
Furui first demonstrated that the identity of both consonant and vowel c...
research
∙
02/16/2018
Bayesian Models for Unit Discovery on a Very Low Resource Language
Developing speech technologies for low-resource languages has become a v...
research
∙
02/15/2018
Deep Learning Based Speech Beamforming
Multi-channel speech enhancement with ad-hoc sensors has been a challeng...
research
∙
02/14/2018
Linguistic unit discovery from multi-modal inputs in unwritten languages: Summary of the "Speaking Rosetta" JSALT 2017 Workshop
We summarize the accomplishments of a multi-disciplinary workshop explor...
research
∙
02/07/2018
Joint Modeling of Accents and Acoustics for Multi-Accent Speech Recognition
The performance of automatic speech recognition systems degrades with in...
research
∙
10/27/2017
Acoustic Landmarks Contain More Information About the Phone String than Other Frames for Automatic Speech Recognition with Deep Neural Network Acoustic Model
Most mainstream Automatic Speech Recognition (ASR) systems consider all ...
research
∙
10/27/2017
Acoustic Landmarks Contain More Information About the Phone String than Other Frames
Most mainstream Automatic Speech Recognition (ASR) systems consider all ...
research
∙
10/05/2017
Dilated Recurrent Neural Networks
Learning with recurrent neural networks (RNNs) on long sequences is a no...
research
∙
12/13/2016
Performance Improvements of Probabilistic Transcript-adapted ASR with Recurrent Neural Network and Language-specific Constraints
Mismatched transcriptions have been proposed as a mean to acquire probab...
research
∙
11/10/2016
Landmark-based consonant voicing detection on multilingual corpora
This paper tests the hypothesis that distinctive feature classifiers anc...
research
∙
07/26/2016
Semantic Image Inpainting with Deep Generative Models
Semantic image inpainting is a challenging task where large missing regi...
research
∙
02/13/2015