research
∙
08/22/2023
SeamlessM4T-Massively Multilingual Multimodal Machine Translation
What does it take to create the Babel Fish, a tool that can help individ...
share
research
∙
07/17/2023
Multilingual Speech-to-Speech Translation into Multiple Target Languages
Speech-to-speech translation (S2ST) enables spoken communication between...
research
∙
04/10/2023
Enhancing Speech-to-Speech Translation with Multiple TTS Targets
It has been known that direct speech-to-speech translation (S2ST) models...
research
∙
01/25/2023
A Holistic Cascade System, benchmark, and Human Evaluation Protocol for Expressive Speech-to-Speech Translation
Expressive speech-to-speech translation (S2ST) aims to transfer prosodic...
research
∙
12/15/2022
UnitY: Two-pass Direct Speech-to-speech Translation with Discrete Units
Direct speech-to-speech translation (S2ST), in which all components can ...
research
∙
11/11/2022
Speech-to-Speech Translation For A Real-world Unwritten Language
We study speech-to-speech translation (S2ST) that translates speech from...
research
∙
11/08/2022
SpeechMatrix: A Large-Scale Mined Corpus of Multilingual Speech-to-Speech Translations
We present SpeechMatrix, a large-scale multilingual corpus of speech-to-...
research
∙
11/06/2022
Bridging Speech and Textual Pre-trained Models with Unsupervised ASR
Spoken language understanding (SLU) is a task aiming to extract high-lev...
research
∙
09/30/2022
On The Robustness of Self-Supervised Representations for Spoken Language Modeling
Self-supervised representations have been extensively studied for discri...
research
∙
04/06/2022
Enhanced Direct Speech-to-Speech Translation Using Self-supervised Pre-training and Data Augmentation
Direct speech-to-speech translation (S2ST) models suffer from data scarc...
research
∙
02/15/2022
textless-lib: a Library for Textless Spoken Language Processing
Textless spoken language processing research aims to extend the applicab...
research
∙
01/29/2022
Flashlight: Enabling Innovation in Tools for Machine Learning
As the computational requirements for machine learning systems and the s...
research
∙
12/15/2021
Textless Speech-to-Speech Translation on Real Data
We present a textless speech-to-speech translation (S2ST) system that ca...
research
∙
10/15/2021
Direct simultaneous speech to speech translation
We present the first direct simultaneous speech-to-speech translation (S...
research
∙
09/14/2021
fairseq S^2: A Scalable and Integrable Speech Synthesis Toolkit
This paper presents fairseq S^2, a fairseq extension for speech synthesi...
research
∙
09/07/2021
Text-Free Prosody-Aware Generative Spoken Language Modeling
Speech pre-training has primarily demonstrated efficacy on classificatio...
research
∙
07/12/2021
Direct speech-to-speech translation with discrete units
We present a direct speech-to-speech translation (S2ST) model that trans...
research
∙
04/02/2021
Robust wav2vec 2.0: Analyzing Domain Shift in Self-Supervised Pre-Training
Self-supervised learning of speech representations has been a very activ...
research
∙
01/02/2021
VoxPopuli: A Large-Scale Multilingual Speech Corpus for Representation Learning, Semi-Supervised Learning and Interpretation
We introduce VoxPopuli, a large-scale multilingual corpus providing 100K...
research
∙
12/17/2020
Few-shot Sequence Learning with Transformers
Few-shot algorithms aim at learning new tasks provided only a handful of...
research
∙
11/16/2020
Facebook AI's WMT20 News Translation Task Submission
This paper describes Facebook AI's submission to WMT20 shared news trans...
research
∙
02/24/2020
Semi-Supervised Speech Recognition via Local Prior Matching
For sequence transduction tasks like speech recognition, a strong struct...
research
∙
09/19/2019
Self-Training for End-to-End Speech Recognition
We revisit self-training in the context of end-to-end speech recognition...
research
∙
04/04/2019