Alexei Baevski

research

∙ 05/22/2023

Scaling Speech Technology to 1,000+ Languages

Expanding the language coverage of speech technology has the potential t...

0 Vineel Pratap, et al. ∙

research

∙ 03/14/2023

OVRL-V2: A simple state-of-art baseline for ImageNav and ObjectNav

We present a single neural network architecture composed of task-agnosti...

0 Karmesh Yadav, et al. ∙

research

∙ 02/10/2023

AV-data2vec: Self-supervised Learning of Audio-Visual Speech Representations with Contextualized Target Representations

Self-supervision has shown great potential for audio-visual speech recog...

0 Jiachen Lian, et al. ∙

research

∙ 12/14/2022

Efficient Self-supervised Learning with Contextualized Target Representations for Vision, Speech and Language

Current self-supervised learning algorithms are often modality-specific ...

0 Alexei Baevski, et al. ∙

research

∙ 11/15/2022

Introducing Semantics into Speech Encoders

Recent studies find existing self-supervised speech encoders contain pri...

10 Derek Xu, et al. ∙

research

∙ 07/13/2022

Masked Autoencoders that Listen

This paper studies a simple extension of image-based Masked Autoencoders...

3 Po-Yao Huang, et al. ∙

research

∙ 06/27/2022

Wav2Vec-Aug: Improved self-supervised training with limited data

Self-supervised learning (SSL) of speech representations has received mu...

0 Anuroop Sriram, et al. ∙

research

∙ 04/27/2022

Offline Visual Representation Learning for Embodied Navigation

How should we learn visual representations for embodied agents that must...

0 Karmesh Yadav, et al. ∙

research

∙ 04/25/2022

On-demand compute reduction with stochastic wav2vec 2.0

Squeeze and Efficient Wav2vec (SEW) is a recently proposed architecture ...

0 Apoorv Vyas, et al. ∙

research

∙ 04/11/2022

Unified Speech-Text Pre-training for Speech Translation and Recognition

We describe a method to jointly pre-train speech and text in an encoder-...

1 Yun Tang, et al. ∙

research

∙ 04/06/2022

Simple and Effective Unsupervised Speech Synthesis

We introduce the first unsupervised speech synthesis system based on a s...

0 Alexander H. Liu, et al. ∙

research

∙ 04/05/2022

Towards End-to-end Unsupervised Speech Recognition

Unsupervised speech recognition has shown great potential to make Automa...

0 Alexander H. Liu, et al. ∙

research

∙ 03/01/2022

Measuring the Impact of Individual Domain Factors in Self-Supervised Pre-Training

Human speech data comprises a rich set of domain factors such as accent,...

0 Ramon Sanabria, et al. ∙

research

∙ 02/07/2022

data2vec: A General Framework for Self-supervised Learning in Speech, Vision and Language

While the general idea of self-supervised learning is identical across m...

0 Alexei Baevski, et al. ∙

research

∙ 11/17/2021

XLS-R: Self-supervised Cross-lingual Speech Representation Learning at Scale

This paper presents XLS-R, a large-scale model for cross-lingual speech ...

0 Arun Babu, et al. ∙

research

∙ 09/23/2021

Simple and Effective Zero-shot Cross-lingual Phoneme Recognition

Recent progress in self-training, self-supervised pretraining and unsupe...

0 Qiantong Xu, et al. ∙

research

∙ 07/08/2021

Improved Language Identification Through Cross-Lingual Self-Supervised Learning

Language identification greatly impacts the success of downstream tasks ...

0 Andros Tjandra, et al. ∙

research

∙ 05/24/2021

Unsupervised Speech Recognition

Despite rapid progress in the recent past, current speech recognition sy...

0 Alexei Baevski, et al. ∙

research

∙ 04/14/2021

Large-Scale Self- and Semi-Supervised Learning for Speech Translation

In this paper, we improve speech translation (ST) through effectively le...

0 Changhan Wang, et al. ∙

research

∙ 04/02/2021

Robust wav2vec 2.0: Analyzing Domain Shift in Self-Supervised Pre-Training

Self-supervised learning of speech representations has been a very activ...

0 Wei-Ning Hsu, et al. ∙

research

∙ 02/01/2021

Generative Spoken Language Modeling from Raw Audio

Generative spoken language modeling involves learning jointly the acoust...

11 Kushal Lakhotia, et al. ∙

research

∙ 12/30/2020

Reservoir Transformer

We demonstrate that transformers obtain impressive performance even when...

23 Sheng Shen, et al. ∙

research

∙ 11/23/2020

The Zero Resource Speech Benchmark 2021: Metrics and baselines for unsupervised spoken language modeling

We introduce a new unsupervised task, spoken language modeling: the lear...

2 Tu Anh Nguyen, et al. ∙

research

∙ 10/24/2020

A Comparison of Discrete Latent Variable Models for Speech Representation Learning

Neural latent variable models enable the discovery of interesting struct...

0 Henry Zhou, et al. ∙

research

∙ 10/22/2020

Self-training and Pre-training are Complementary for Speech Recognition

Self-training and unsupervised pre-training have emerged as effective ap...

0 Qiantong Xu, et al. ∙

research

∙ 06/24/2020

Unsupervised Cross-lingual Representation Learning for Speech Recognition

This paper presents XLSR which learns cross-lingual speech representatio...

0 Alexis Conneau, et al. ∙

research

∙ 06/20/2020

wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representations

We show for the first time that learning powerful representations from s...

0 Alexei Baevski, et al. ∙

research

∙ 11/10/2019

Effectiveness of self-supervised pre-training for speech recognition

We present pre-training approaches for self-supervised representation le...

0 Alexei Baevski, et al. ∙

research

∙ 10/12/2019

vq-wav2vec: Self-Supervised Learning of Discrete Speech Representations

We propose vq-wav2vec to learn discrete representations of audio segment...

0 Alexei Baevski, et al. ∙

research

∙ 07/15/2019

Facebook FAIR's WMT19 News Translation Task Submission

This paper describes Facebook FAIR's submission to the WMT19 shared news...

0 Nathan Ng, et al. ∙

research

∙ 04/11/2019

wav2vec: Unsupervised Pre-training for Speech Recognition

We explore unsupervised pre-training for speech recognition by learning ...

0 Steffen Schneider, et al. ∙

research

∙ 04/01/2019

fairseq: A Fast, Extensible Toolkit for Sequence Modeling

fairseq is an open-source sequence modeling toolkit that allows research...

0 Myle Ott, et al. ∙

research

∙ 03/22/2019

Pre-trained Language Model Representations for Language Generation

Pre-trained language model representations have been successful in a wid...

0 Sergey Edunov, et al. ∙

research

∙ 03/19/2019

Cloze-driven Pretraining of Self-attention Networks

We present a new approach for pretraining a bi-directional transformer m...

0 Alexei Baevski, et al. ∙

research

∙ 01/29/2019

Pay Less Attention with Lightweight and Dynamic Convolutions

Self-attention is a useful mechanism to build generative models for lang...

0 Felix Wu, et al. ∙

research

∙ 09/28/2018

Adaptive Input Representations for Neural Language Modeling

We introduce adaptive input representations for neural language modeling...

0 Alexei Baevski, et al. ∙

Alexei Baevski

Featured Co-authors