research
∙
06/03/2023
Acoustic Word Embeddings for Untranscribed Target Languages with Continued Pretraining and Learned Pooling
Acoustic word embeddings are typically created by training a pooling fun...
share
research
∙
03/31/2023
The Edinburgh International Accents of English Corpus: Towards the Democratization of English ASR
English is the most widely spoken language in the world, used daily by m...
research
∙
10/28/2022
Analyzing Acoustic Word Embeddings from Pre-trained Self-supervised Speech Models
Given the strong results of self-supervised models on various tasks, the...
research
∙
03/01/2022
Measuring the Impact of Individual Domain Factors in Self-Supervised Pre-Training
Human speech data comprises a rich set of domain factors such as accent,...
research
∙
09/21/2021
On the Difficulty of Segmenting Words with Attention
Word segmentation, the problem of finding word boundaries in speech, is ...
research
∙
04/05/2021
Talk, Don't Write: A Study of Direct Speech-Based Image Retrieval
Speech-based image retrieval has been studied as a proxy for joint repre...
research
∙
10/16/2020
Multimodal Speech Recognition with Unstructured Audio Masking
Visual context has been shown to be useful for automatic speech recognit...
research
∙
10/05/2020
Fine-Grained Grounding for Multimodal Speech Recognition
Multimodal automatic speech recognition systems integrate information fr...
research
∙
02/13/2020
Looking Enhances Listening: Recovering Missing Speech Using Images
Speech is understood better by using visual context; for this reason, th...
research
∙
10/27/2019
Multitask Learning For Different Subword Segmentations In Neural Machine Translation
In Neural Machine Translation (NMT) the usage of subwords and characters...
research
∙
06/30/2019
Analyzing Utility of Visual Context in Multimodal Speech Recognition Under Noisy Conditions
Multimodal learning allows us to leverage information from multiple sour...
research
∙
06/13/2019
Grounding Object Detections With Transcriptions
A vast amount of audio-visual data is available on the Internet thanks t...
research
∙
11/09/2018
Multimodal Grounding for Sequence-to-Sequence Speech Recognition
Humans are capable of processing speech by making use of multiple sensor...
research
∙
11/01/2018
How2: A Large-scale Dataset for Multimodal Language Understanding
In this paper, we introduce How2, a multimodal collection of instruction...
research
∙
07/18/2018
Hierarchical Multi Task Learning With CTC
In Automatic Speech Recognition, it is still challenging to learn useful...
research
∙
04/25/2018
End-to-End Multimodal Speech Recognition
Transcription or sub-titling of open-domain videos is still a challengin...
research
∙
02/21/2018
Sequence-based Multi-lingual Low Resource Speech Recognition
Techniques for multi-lingual and cross-lingual speech recognition can he...
research
∙
12/19/2017
Subword and Crossword Units for CTC Acoustic Models
This paper proposes a novel approach to create an unit set for CTC based...
research
∙
08/15/2017
Comparison of Decoding Strategies for CTC Acoustic Models
Connectionist Temporal Classification has recently attracted a lot of in...
research
∙
11/21/2016