research
∙
09/14/2023
A Data Source for Reasoning Embodied Agents
Recent progress in using machine learning models for reasoning tasks has...
share
research
∙
09/11/2023
Large Language Models for Compiler Optimization
We explore the novel application of Large Language Models to code optimi...
research
∙
08/24/2023
Code Llama: Open Foundation Models for Code
We release Code Llama, a family of large language models for code based ...
research
∙
08/10/2023
EXPRESSO: A Benchmark and Analysis of Discrete Expressive Speech Resynthesis
Recent work has shown that it is possible to resynthesize high-quality s...
research
∙
08/02/2023
From Discrete Tokens to High-Fidelity Audio Using Multi-Band Diffusion
Deep generative models can generate high-fidelity audio conditioned on v...
research
∙
06/08/2023
Simple and Controllable Music Generation
We tackle the task of conditional music generation. We introduce MusicGe...
research
∙
05/22/2023
Textually Pretrained Speech Language Models
Speech language models (SpeechLMs) process and generate acoustic data on...
research
∙
04/20/2023
Leveraging Static Analysis for Bug Repair
We propose a method combining machine learning with a static analysis to...
research
∙
04/14/2023
DINOv2: Learning Robust Visual Features without Supervision
The recent breakthroughs in natural language processing for model pretra...
research
∙
12/21/2022
Contrastive Distillation Is a Sample-Efficient Self-Supervised Loss Policy for Transfer Learning
Traditional approaches to RL have focused on learning decision policies ...
research
∙
11/02/2022
Audio Language Modeling using Perceptually-Guided Discrete Representations
In this work, we study the task of Audio Language Modeling, in which we ...
research
∙
10/26/2022
Leveraging Demonstrations with Latent Space Priors
Demonstrations provide insight into relevant state or action space regio...
research
∙
10/24/2022
High Fidelity Neural Audio Compression
We introduce a state-of-the-art real-time, high-fidelity, audio codec le...
research
∙
09/30/2022
On The Robustness of Self-Supervised Representations for Spoken Language Modeling
Self-supervised representations have been extensively studied for discri...
research
∙
06/30/2022
Code Translation with Compiler Representations
In this paper, we leverage low-level compiler intermediate representatio...
research
∙
01/29/2022
Flashlight: Enabling Innovation in Tools for Machine Learning
As the computational requirements for machine learning systems and the s...
research
∙
01/28/2022
Star Temporal Classification: Sequence Classification with Partially Labeled Data
We develop an algorithm which can learn from partially labeled and unseg...
research
∙
12/27/2021
Augmenting Convolutional networks with attention-based aggregation
We show how to augment any convolutional network with an attention-based...
research
∙
10/30/2021
Pseudo-Labeling for Massively Multilingual Speech Recognition
Semi-supervised learning through pseudo-labeling has become a staple of ...
research
∙
10/20/2021
Hierarchical Skills for Efficient Exploration
In reinforcement learning, pre-trained low-level skills have the potenti...
research
∙
10/16/2021
ASR4REAL: An extended benchmark for speech models
Popular ASR benchmarks such as Librispeech and Switchboard are limited i...
research
∙
10/13/2021
Leveraging Automated Unit Tests for Unsupervised Code Translation
With little to no parallel data available for programming languages, uns...
research
∙
10/12/2021
Word Order Does Not Matter For Speech Recognition
In this paper, we study training of automatic speech recognition system ...
research
∙
06/17/2021
XCiT: Cross-Covariance Image Transformers
Following their success in natural language processing, transformers hav...
research
∙
06/06/2021
CAPE: Encoding Relative Positions with Continuous Augmented Positional Embeddings
Without positional information, attention-based transformer neural netwo...
research
∙
05/07/2021
ResMLP: Feedforward networks for image classification with data-efficient training
We present ResMLP, an architecture built entirely upon multi-layer perce...
research
∙
04/26/2021
MDETR – Modulated Detection for End-to-End Multi-Modal Understanding
Multi-modal reasoning systems rely on a pre-trained object detector to e...
research
∙
04/20/2021
Differentiable Model Compression via Pseudo Quantization Noise
We propose to add independent pseudo quantization noise to model paramet...
research
∙
04/20/2021
Gradient Matching for Domain Generalization
Machine learning systems typically assume that the distributions of trai...
research
∙
04/02/2021
Robust wav2vec 2.0: Analyzing Domain Shift in Self-Supervised Pre-Training
Self-supervised learning of speech representations has been a very activ...
research
∙
03/31/2021
Going deeper with Image Transformers
Transformers have been recently adapted for large scale image classifica...
research
∙
12/07/2020
MLS: A Large-Scale Multilingual Dataset for Speech Research
This paper introduces Multilingual LibriSpeech (MLS) dataset, a large mu...
research
∙
10/30/2020
Joint Masked CPC and CTC Training for ASR
Self-supervised learning (SSL) has shown promise in learning representat...
research
∙
10/22/2020
Rethinking Evaluation in ASR: Are Our Models Robust Enough?
Is pushing numbers on a single benchmark valuable in automatic speech re...
research
∙
10/22/2020
slimIPL: Language-Model-Free Iterative Pseudo-Labeling
Recent results in end-to-end ASR have demonstrated the efficacy of simpl...
research
∙
10/22/2020
Self-training and Pre-training are Complementary for Speech Recognition
Self-training and unsupervised pre-training have emerged as effective ap...
research
∙
10/08/2020
Population Based Training for Data Augmentation and Regularization in Speech Recognition
Varying data augmentation policies and regularization over the course of...
research
∙
07/06/2020
Massively Multilingual ASR: 50 Languages, 1 Model, 1 Billion Parameters
We study training a single acoustic model for multiple languages with th...
research
∙
07/02/2020
Data Augmenting Contrastive Learning of Speech Representations in the Time Domain
Contrastive Predictive Coding (CPC), based on predicting future segments...
research
∙
06/23/2020
Real Time Speech Enhancement in the Waveform Domain
We present a causal speech enhancement model working on the raw waveform...
research
∙
05/26/2020
End-to-End Object Detection with Transformers
We present a new method that views object detection as a direct set pred...
research
∙
05/19/2020
Iterative Pseudo-Labeling for Speech Recognition
Pseudo-labeling has recently shown promise in end-to-end automatic speec...
research
∙
05/15/2020
Contextualizing ASR Lattice Rescoring with Hybrid Pointer Network Language Model
Videos uploaded on social media are often accompanied with textual descr...
research
∙
02/24/2020
Semi-Supervised Speech Recognition via Local Prior Matching
For sequence transduction tasks like speech recognition, a strong struct...
research
∙
01/27/2020
Polygames: Improved Zero Learning
Since DeepMind's AlphaZero, Zero learning quickly became the state-of-th...
research
∙
01/27/2020
Scaling Up Online Speech Recognition Using ConvNets
We design an online end-to-end speech recognition system based on Time-D...
research
∙
12/17/2019
Libri-Light: A Benchmark for ASR with Limited or No Supervision
We introduce a new collection of spoken English audio suitable for train...
research
∙
11/19/2019
End-to-end ASR: from Supervised to Semi-Supervised Learning with Modern Architectures
We study ResNet-, Time-Depth Separable ConvNets-, and Transformer-based ...
research
∙
10/23/2019
Deja-vu: Double Feature Presentation in Deep Transformer Networks
Deep acoustic models typically receive features in the first layer of th...
research
∙
10/19/2019