b'Mike Lewis'

Question Answering Infused Pre-training of General-Purpose Contextualized Representations

This paper proposes a pre-training objective based on question answering...
06/15/2021 ∙ by Robin Jia, et al. ∙ 0 ∙ share

read it
Multitasking Inhibits Semantic Drift

When intelligent agents communicate to accomplish shared goals, how do t...
04/15/2021 ∙ by Athul Paul Jacob, et al. ∙ 0 ∙ share

read it
BASE Layers: Simplifying Training of Large, Sparse Models

We introduce a new balanced assignment of experts (BASE) layer for large...
03/30/2021 ∙ by Mike Lewis, et al. ∙ 0 ∙ share

read it
Shortformer: Better Language Modeling using Shorter Inputs

We explore the benefits of decreasing the input length of transformers. ...
12/31/2020 ∙ by Ofir Press, et al. ∙ 0 ∙ share

read it
Joint Verification and Reranking for Open Fact Checking Over Tables

Structured information is an important knowledge source for automatic ve...
12/30/2020 ∙ by Michael Schlichtkrull, et al. ∙ 0 ∙ share

read it
Nearest Neighbor Machine Translation

We introduce k-nearest-neighbor machine translation (kNN-MT), which pred...
10/01/2020 ∙ by Urvashi Khandelwal, et al. ∙ 0 ∙ share

read it
Conversational Semantic Parsing

The structured representation for semantic parsing in task-oriented assi...
09/28/2020 ∙ by Armen Aghajanyan, et al. ∙ 0 ∙ share

read it
Grounded Adaptation for Zero-shot Executable Semantic Parsing

We propose Grounded Adaptation for Zero-shot Executable Semantic Parsing...
09/16/2020 ∙ by Victor Zhong, et al. ∙ 5 ∙ share

read it
Pre-training via Paraphrasing

We introduce MARGE, a pre-trained sequence-to-sequence model learned wit...
06/26/2020 ∙ by Mike Lewis, et al. ∙ 7 ∙ share

read it
Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks

Large pre-trained language models have been shown to store factual knowl...
05/22/2020 ∙ by Patrick Lewis, et al. ∙ 0 ∙ share

read it
Asking and Answering Questions to Evaluate the Factual Consistency of Summaries

Practical applications of abstractive summarization models are limited b...
04/08/2020 ∙ by Alex Wang, et al. ∙ 0 ∙ share

read it
Multilingual Denoising Pre-training for Neural Machine Translation

This paper demonstrates that multilingual denoising pre-training produce...
01/22/2020 ∙ by Yinhan Liu, et al. ∙ 0 ∙ share

read it
Enforcing Encoder-Decoder Modularity in Sequence-to-Sequence Models

Inspired by modular software design principles of independence, intercha...
11/09/2019 ∙ by Siddharth Dalmia, et al. ∙ 0 ∙ share

read it
Generalization through Memorization: Nearest Neighbor Language Models

We introduce kNN-LMs, which extend a pre-trained neural language model (...
11/01/2019 ∙ by Urvashi Khandelwal, et al. ∙ 0 ∙ share

read it
BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension

We present BART, a denoising autoencoder for pretraining sequence-to-seq...
10/29/2019 ∙ by Mike Lewis, et al. ∙ 35 ∙ share

read it
RoBERTa: A Robustly Optimized BERT Pretraining Approach

Language model pretraining has led to significant performance gains but ...
07/26/2019 ∙ by Yinhan Liu, et al. ∙ 0 ∙ share

read it
MelNet: A Generative Model for Audio in the Frequency Domain

Capturing high-level structure in audio waveforms is challenging because...
06/04/2019 ∙ by Sean Vasquez, et al. ∙ 0 ∙ share

read it
Hierarchical Decision Making by Generating and Following Natural Language Instructions

We explore using latent natural language instructions as an expressive a...
06/03/2019 ∙ by Hengyuan Hu, et al. ∙ 4 ∙ share

read it
Improving Semantic Parsing for Task Oriented Dialog

Semantic parsing using hierarchical representations has recently been pr...
02/15/2019 ∙ by Arash Einolghozati, et al. ∙ 2 ∙ share

read it
Strategies for Structuring Story Generation

Writers generally rely on plans or sketches to write long stories, but m...
02/04/2019 ∙ by Angela Fan, et al. ∙ 0 ∙ share

read it
Cross-lingual Transfer Learning for Multilingual Task Oriented Dialog

One of the first steps in the utterance interpretation pipeline of many ...
10/31/2018 ∙ by Sebastian Schuster, et al. ∙ 0 ∙ share

read it
Semantic Parsing for Task Oriented Dialog using Hierarchical Representations

Task oriented dialog systems typically first parse user utterances to se...
10/18/2018 ∙ by Sonal Gupta, et al. ∙ 0 ∙ share

read it
Neural Compositional Denotational Semantics for Question Answering

Answering compositional questions requiring multi-step reasoning is chal...
08/29/2018 ∙ by Nitish Gupta, et al. ∙ 0 ∙ share

read it
Community Regularization of Visually-Grounded Dialog

The task of conducting visually grounded dialog involves learning goal-o...
08/10/2018 ∙ by Akshat Agarwal, et al. ∙ 0 ∙ share

read it
Hierarchical Neural Story Generation

We explore story generation: creative systems that can build coherent an...
05/13/2018 ∙ by Angela Fan, et al. ∙ 0 ∙ share

read it
Hierarchical Text Generation and Planning for Strategic Dialogue

End-to-end models for strategic dialogue are challenging to train, becau...
12/15/2017 ∙ by Denis Yarats, et al. ∙ 0 ∙ share

read it
End-to-end Neural Coreference Resolution

We introduce the first end-to-end coreference resolution model and show ...
07/21/2017 ∙ by Kenton Lee, et al. ∙ 0 ∙ share

read it
Deal or No Deal? End-to-End Learning for Negotiation Dialogues

Much of human dialogue occurs in semi-cooperative settings, where agents...
06/16/2017 ∙ by Mike Lewis, et al. ∙ 0 ∙ share

read it
Global Neural CCG Parsing with Optimality Guarantees

We introduce the first global recursive neural parsing model with optima...
07/05/2016 ∙ by Kenton Lee, et al. ∙ 0 ∙ share

read it

Mike Lewis

Featured Co-authors