Gabriel Synnaeve

research

∙ 09/14/2023

A Data Source for Reasoning Embodied Agents

Recent progress in using machine learning models for reasoning tasks has...

0 Jack Lanchantin, et al. ∙

research

∙ 09/11/2023

Large Language Models for Compiler Optimization

We explore the novel application of Large Language Models to code optimi...

0 Chris Cummins, et al. ∙

research

∙ 08/24/2023

Code Llama: Open Foundation Models for Code

We release Code Llama, a family of large language models for code based ...

0 Baptiste Roziere, et al. ∙

research

∙ 08/10/2023

EXPRESSO: A Benchmark and Analysis of Discrete Expressive Speech Resynthesis

Recent work has shown that it is possible to resynthesize high-quality s...

0 Tu Anh Nguyen, et al. ∙

research

∙ 08/02/2023

From Discrete Tokens to High-Fidelity Audio Using Multi-Band Diffusion

Deep generative models can generate high-fidelity audio conditioned on v...

0 Robin San-Roman, et al. ∙

research

∙ 06/08/2023

Simple and Controllable Music Generation

We tackle the task of conditional music generation. We introduce MusicGe...

0 Jade Copet, et al. ∙

research

∙ 05/22/2023

Textually Pretrained Speech Language Models

Speech language models (SpeechLMs) process and generate acoustic data on...

0 Michael Hassid, et al. ∙

research

∙ 04/20/2023

Leveraging Static Analysis for Bug Repair

We propose a method combining machine learning with a static analysis to...

0 Ruba Mutasim, et al. ∙

research

∙ 04/14/2023

DINOv2: Learning Robust Visual Features without Supervision

The recent breakthroughs in natural language processing for model pretra...

1 Maxime Oquab, et al. ∙

research

∙ 12/21/2022

Contrastive Distillation Is a Sample-Efficient Self-Supervised Loss Policy for Transfer Learning

Traditional approaches to RL have focused on learning decision policies ...

0 Chris Lengerich, et al. ∙

research

∙ 11/02/2022

Audio Language Modeling using Perceptually-Guided Discrete Representations

In this work, we study the task of Audio Language Modeling, in which we ...

0 Felix Kreuk, et al. ∙

research

∙ 10/26/2022

Leveraging Demonstrations with Latent Space Priors

Demonstrations provide insight into relevant state or action space regio...

0 Jonas Gehring, et al. ∙

research

∙ 10/24/2022

High Fidelity Neural Audio Compression

We introduce a state-of-the-art real-time, high-fidelity, audio codec le...

0 Alexandre Défossez, et al. ∙

research

∙ 09/30/2022

On The Robustness of Self-Supervised Representations for Spoken Language Modeling

Self-supervised representations have been extensively studied for discri...

8 Itai Gat, et al. ∙

research

∙ 06/30/2022

Code Translation with Compiler Representations

In this paper, we leverage low-level compiler intermediate representatio...

0 Marc Szafraniec, et al. ∙

research

∙ 01/29/2022

Flashlight: Enabling Innovation in Tools for Machine Learning

As the computational requirements for machine learning systems and the s...

0 Jacob Kahn, et al. ∙

research

∙ 01/28/2022

Star Temporal Classification: Sequence Classification with Partially Labeled Data

We develop an algorithm which can learn from partially labeled and unseg...

0 Vineel Pratap, et al. ∙

research

∙ 12/27/2021

Augmenting Convolutional networks with attention-based aggregation

We show how to augment any convolutional network with an attention-based...

24 Hugo Touvron, et al. ∙

research

∙ 10/30/2021

Pseudo-Labeling for Massively Multilingual Speech Recognition

Semi-supervised learning through pseudo-labeling has become a staple of ...

0 Loren Lugosch, et al. ∙

research

∙ 10/20/2021

Hierarchical Skills for Efficient Exploration

In reinforcement learning, pre-trained low-level skills have the potenti...

3 Jonas Gehring, et al. ∙

research

∙ 10/16/2021

ASR4REAL: An extended benchmark for speech models

Popular ASR benchmarks such as Librispeech and Switchboard are limited i...

5 Morgane Riviere, et al. ∙

research

∙ 10/13/2021

Leveraging Automated Unit Tests for Unsupervised Code Translation

With little to no parallel data available for programming languages, uns...

0 Baptiste Roziere, et al. ∙

research

∙ 10/12/2021

Word Order Does Not Matter For Speech Recognition

In this paper, we study training of automatic speech recognition system ...

0 Vineel Pratap, et al. ∙

research

∙ 06/17/2021

XCiT: Cross-Covariance Image Transformers

Following their success in natural language processing, transformers hav...

0 Alaaeldin El-Nouby, et al. ∙

research

∙ 06/06/2021

CAPE: Encoding Relative Positions with Continuous Augmented Positional Embeddings

Without positional information, attention-based transformer neural netwo...

0 Tatiana Likhomanenko, et al. ∙

research

∙ 05/07/2021

ResMLP: Feedforward networks for image classification with data-efficient training

We present ResMLP, an architecture built entirely upon multi-layer perce...

43 Hugo Touvron, et al. ∙

research

∙ 04/26/2021

MDETR – Modulated Detection for End-to-End Multi-Modal Understanding

Multi-modal reasoning systems rely on a pre-trained object detector to e...

10 Aishwarya Kamath, et al. ∙

research

∙ 04/20/2021

Differentiable Model Compression via Pseudo Quantization Noise

We propose to add independent pseudo quantization noise to model paramet...

0 Alexandre Défossez, et al. ∙

research

∙ 04/20/2021

Gradient Matching for Domain Generalization

Machine learning systems typically assume that the distributions of trai...

0 Yuge Shi, et al. ∙

research

∙ 04/02/2021

Robust wav2vec 2.0: Analyzing Domain Shift in Self-Supervised Pre-Training

Self-supervised learning of speech representations has been a very activ...

0 Wei-Ning Hsu, et al. ∙

research

∙ 03/31/2021

Going deeper with Image Transformers

Transformers have been recently adapted for large scale image classifica...

0 Hugo Touvron, et al. ∙

research

∙ 12/07/2020

MLS: A Large-Scale Multilingual Dataset for Speech Research

This paper introduces Multilingual LibriSpeech (MLS) dataset, a large mu...

0 Vineel Pratap, et al. ∙

research

∙ 10/30/2020

Joint Masked CPC and CTC Training for ASR

Self-supervised learning (SSL) has shown promise in learning representat...

0 Chaitanya Talnikar, et al. ∙

research

∙ 10/22/2020

Rethinking Evaluation in ASR: Are Our Models Robust Enough?

Is pushing numbers on a single benchmark valuable in automatic speech re...

0 Tatiana Likhomanenko, et al. ∙

research

∙ 10/22/2020

slimIPL: Language-Model-Free Iterative Pseudo-Labeling

Recent results in end-to-end ASR have demonstrated the efficacy of simpl...

0 Tatiana Likhomanenko, et al. ∙

research

∙ 10/22/2020

Self-training and Pre-training are Complementary for Speech Recognition

Self-training and unsupervised pre-training have emerged as effective ap...

0 Qiantong Xu, et al. ∙

research

∙ 10/08/2020

Population Based Training for Data Augmentation and Regularization in Speech Recognition

Varying data augmentation policies and regularization over the course of...

0 Daniel Haziza, et al. ∙

research

∙ 07/06/2020

Massively Multilingual ASR: 50 Languages, 1 Model, 1 Billion Parameters

We study training a single acoustic model for multiple languages with th...

0 Vineel Pratap, et al. ∙

research

∙ 07/02/2020

Data Augmenting Contrastive Learning of Speech Representations in the Time Domain

Contrastive Predictive Coding (CPC), based on predicting future segments...

0 Eugene Kharitonov, et al. ∙

research

∙ 06/23/2020

Real Time Speech Enhancement in the Waveform Domain

We present a causal speech enhancement model working on the raw waveform...

0 Alexandre Défossez, et al. ∙

research

∙ 05/26/2020

End-to-End Object Detection with Transformers

We present a new method that views object detection as a direct set pred...

23 Nicolas Carion, et al. ∙

research

∙ 05/19/2020

Iterative Pseudo-Labeling for Speech Recognition

Pseudo-labeling has recently shown promise in end-to-end automatic speec...

0 Qiantong Xu, et al. ∙

research

∙ 05/15/2020

Contextualizing ASR Lattice Rescoring with Hybrid Pointer Network Language Model

Videos uploaded on social media are often accompanied with textual descr...

0 Da-Rong Liu, et al. ∙

research

∙ 02/24/2020

Semi-Supervised Speech Recognition via Local Prior Matching

For sequence transduction tasks like speech recognition, a strong struct...

0 Wei-Ning Hsu, et al. ∙

research

∙ 01/27/2020

Polygames: Improved Zero Learning

Since DeepMind's AlphaZero, Zero learning quickly became the state-of-th...

12 Tristan Cazenave, et al. ∙

research

∙ 01/27/2020

Scaling Up Online Speech Recognition Using ConvNets

We design an online end-to-end speech recognition system based on Time-D...

0 Vineel Pratap, et al. ∙

research

∙ 12/17/2019

Libri-Light: A Benchmark for ASR with Limited or No Supervision

We introduce a new collection of spoken English audio suitable for train...

0 Jacob Kahn, et al. ∙

research

∙ 11/19/2019

End-to-end ASR: from Supervised to Semi-Supervised Learning with Modern Architectures

We study ResNet-, Time-Depth Separable ConvNets-, and Transformer-based ...

0 Gabriel Synnaeve, et al. ∙

research

∙ 10/23/2019

Deja-vu: Double Feature Presentation in Deep Transformer Networks

Deep acoustic models typically receive features in the first layer of th...

0 Andros Tjandra, et al. ∙

research

∙ 10/19/2019

A Structured Prediction Approach for Generalization in Cooperative Multi-Agent Reinforcement Learning

Effective coordination is crucial to solve multi-agent collaborative (MA...

14 Nicolas Carion, et al. ∙

Gabriel Synnaeve

Featured Co-authors