research
∙
05/22/2023
Scaling Speech Technology to 1,000+ Languages
Expanding the language coverage of speech technology has the potential t...
share
research
∙
05/17/2023
DinoSR: Self-Distillation and Online Clustering for Self-supervised Speech Representation Learning
In this paper, we introduce self-distillation and online clustering for ...
research
∙
02/10/2023
AV-data2vec: Self-supervised Learning of Audio-Visual Speech Representations with Contextualized Target Representations
Self-supervision has shown great potential for audio-visual speech recog...
research
∙
12/14/2022
Efficient Self-supervised Learning with Contextualized Target Representations for Vision, Speech and Language
Current self-supervised learning algorithms are often modality-specific ...
research
∙
10/18/2022
Simple and Effective Unsupervised Speech Translation
The amount of labeled data to train models for speech tasks is limited f...
research
∙
07/13/2022
Masked Autoencoders that Listen
This paper studies a simple extension of image-based Masked Autoencoders...
research
∙
06/27/2022
Wav2Vec-Aug: Improved self-supervised training with limited data
Self-supervised learning (SSL) of speech representations has received mu...
research
∙
04/25/2022
On-demand compute reduction with stochastic wav2vec 2.0
Squeeze and Efficient Wav2vec (SEW) is a recently proposed architecture ...
research
∙
04/11/2022
Unified Speech-Text Pre-training for Speech Translation and Recognition
We describe a method to jointly pre-train speech and text in an encoder-...
research
∙
04/06/2022
Simple and Effective Unsupervised Speech Synthesis
We introduce the first unsupervised speech synthesis system based on a s...
research
∙
04/05/2022
Towards End-to-end Unsupervised Speech Recognition
Unsupervised speech recognition has shown great potential to make Automa...
research
∙
03/21/2022
XTREME-S: Evaluating Cross-lingual Speech Representations
We introduce XTREME-S, a new benchmark to evaluate universal cross-lingu...
research
∙
03/01/2022
Measuring the Impact of Individual Domain Factors in Self-Supervised Pre-Training
Human speech data comprises a rich set of domain factors such as accent,...
research
∙
02/07/2022
data2vec: A General Framework for Self-supervised Learning in Speech, Vision and Language
While the general idea of self-supervised learning is identical across m...
research
∙
11/17/2021
XLS-R: Self-supervised Cross-lingual Speech Representation Learning at Scale
This paper presents XLS-R, a large-scale model for cross-lingual speech ...
research
∙
09/23/2021
Simple and Effective Zero-shot Cross-lingual Phoneme Recognition
Recent progress in self-training, self-supervised pretraining and unsupe...
research
∙
07/08/2021
Improved Language Identification Through Cross-Lingual Self-Supervised Learning
Language identification greatly impacts the success of downstream tasks ...
research
∙
05/24/2021
Unsupervised Speech Recognition
Despite rapid progress in the recent past, current speech recognition sy...
research
∙
04/14/2021
Large-Scale Self- and Semi-Supervised Learning for Speech Translation
In this paper, we improve speech translation (ST) through effectively le...
research
∙
04/02/2021
Robust wav2vec 2.0: Analyzing Domain Shift in Self-Supervised Pre-Training
Self-supervised learning of speech representations has been a very activ...
research
∙
01/26/2021
A Comparison of Approaches to Document-level Machine Translation
Document-level machine translation conditions on surrounding sentences t...
research
∙
12/30/2020
Reservoir Transformer
We demonstrate that transformers obtain impressive performance even when...
research
∙
11/13/2020
Language Models not just for Pre-training: Fast Online Neural Noisy Channel Modeling
Pre-training models on vast quantities of unlabeled data has emerged as ...
research
∙
10/24/2020
A Comparison of Discrete Latent Variable Models for Speech Representation Learning
Neural latent variable models enable the discovery of interesting struct...
research
∙
10/22/2020
Self-training and Pre-training are Complementary for Speech Recognition
Self-training and unsupervised pre-training have emerged as effective ap...
research
∙
10/21/2020
Beyond English-Centric Multilingual Machine Translation
Existing work in translation demonstrated the potential of massively mul...
research
∙
10/05/2020
Self-training Improves Pre-training for Natural Language Understanding
Unsupervised pre-training has led to much recent progress in natural lan...
research
∙
06/24/2020
Unsupervised Cross-lingual Representation Learning for Speech Recognition
This paper presents XLSR which learns cross-lingual speech representatio...
research
∙
06/20/2020
wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representations
We show for the first time that learning powerful representations from s...
research
∙
03/24/2020
Robust and On-the-fly Dataset Denoising for Image Classification
Memorization in over-parameterized neural networks could severely hurt g...
research
∙
11/21/2019
Improving Conditioning in Context-Aware Sequence to Sequence Models
Neural sequence to sequence models are well established for applications...
research
∙
11/10/2019
Effectiveness of self-supervised pre-training for speech recognition
We present pre-training approaches for self-supervised representation le...
research
∙
10/22/2019
Depth-Adaptive Transformer
State of the art sequence-to-sequence models perform a fixed number of c...
research
∙
10/12/2019
vq-wav2vec: Self-Supervised Learning of Discrete Speech Representations
We propose vq-wav2vec to learn discrete representations of audio segment...
research
∙
09/28/2019
The Source-Target Domain Mismatch Problem in Machine Translation
While we live in an increasingly interconnected world, different places ...
research
∙
08/15/2019
Simple and Effective Noisy Channel Modeling for Neural Machine Translation
Previous work on neural noisy channel modeling relied on latent variable...
research
∙
08/14/2019
On The Evaluation of Machine Translation Systems Trained With Back-Translation
Back-translation is a widely used data augmentation technique which leve...
research
∙
07/22/2019
ELI5: Long Form Question Answering
We introduce the first large-scale corpus for long-form question answeri...
research
∙
07/15/2019
Facebook FAIR's WMT19 News Translation Task Submission
This paper describes Facebook FAIR's submission to the WMT19 shared news...
research
∙
07/15/2019
GLOSS: Generative Latent Optimization of Sentence Representations
We propose a method to learn unsupervised sentence representations in a ...
research
∙
04/11/2019
wav2vec: Unsupervised Pre-training for Speech Recognition
We explore unsupervised pre-training for speech recognition by learning ...
research
∙
04/01/2019
fairseq: A Fast, Extensible Toolkit for Sequence Modeling
fairseq is an open-source sequence modeling toolkit that allows research...
research
∙
03/22/2019
Pre-trained Language Model Representations for Language Generation
Pre-trained language model representations have been successful in a wid...
research
∙
03/19/2019
Cloze-driven Pretraining of Self-attention Networks
We present a new approach for pretraining a bi-directional transformer m...
research
∙
02/20/2019
Mixture Models for Diverse Machine Translation: Tricks of the Trade
Mixture models trained via EM are among the simplest, most widely used a...
research
∙
01/29/2019
Pay Less Attention with Lightweight and Dynamic Convolutions
Self-attention is a useful mechanism to build generative models for lang...
research
∙
01/21/2019
Modeling Human Motion with Quaternion-based Neural Networks
Previous work on predicting or generating 3D human pose sequences regres...
research
∙
11/28/2018
3D human pose estimation in video with temporal convolutions and semi-supervised training
In this work, we demonstrate that 3D poses in video can be effectively e...
research
∙
11/03/2018
Wizard of Wikipedia: Knowledge-Powered Conversational agents
In open-domain dialogue intelligent agents should exhibit the use of kno...
research
∙
09/28/2018
