b'Mike Lewis'

Shortformer: Better Language Modeling using Shorter Inputs

We explore the benefits of decreasing the input length of transformers. ...
12/31/2020 ∙ by Ofir Press, et al. ∙ 0 ∙ share

read it
Joint Verification and Reranking for Open Fact Checking Over Tables

Structured information is an important knowledge source for automatic ve...
12/30/2020 ∙ by Michael Schlichtkrull, et al. ∙ 0 ∙ share

read it
Nearest Neighbor Machine Translation

We introduce k-nearest-neighbor machine translation (kNN-MT), which pred...
10/01/2020 ∙ by Urvashi Khandelwal, et al. ∙ 0 ∙ share

read it
Conversational Semantic Parsing

The structured representation for semantic parsing in task-oriented assi...
09/28/2020 ∙ by Armen Aghajanyan, et al. ∙ 0 ∙ share

read it
Grounded Adaptation for Zero-shot Executable Semantic Parsing

We propose Grounded Adaptation for Zero-shot Executable Semantic Parsing...
09/16/2020 ∙ by Victor Zhong, et al. ∙ 5 ∙ share

read it
Pre-training via Paraphrasing

We introduce MARGE, a pre-trained sequence-to-sequence model learned wit...
06/26/2020 ∙ by Mike Lewis, et al. ∙ 7 ∙ share

read it
Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks

Large pre-trained language models have been shown to store factual knowl...
05/22/2020 ∙ by Patrick Lewis, et al. ∙ 0 ∙ share

read it
Asking and Answering Questions to Evaluate the Factual Consistency of Summaries

Practical applications of abstractive summarization models are limited b...
04/08/2020 ∙ by Alex Wang, et al. ∙ 0 ∙ share

read it
Multilingual Denoising Pre-training for Neural Machine Translation

This paper demonstrates that multilingual denoising pre-training produce...
01/22/2020 ∙ by Yinhan Liu, et al. ∙ 0 ∙ share

read it
Enforcing Encoder-Decoder Modularity in Sequence-to-Sequence Models

Inspired by modular software design principles of independence, intercha...
11/09/2019 ∙ by Siddharth Dalmia, et al. ∙ 0 ∙ share

read it
Generalization through Memorization: Nearest Neighbor Language Models

We introduce kNN-LMs, which extend a pre-trained neural language model (...
11/01/2019 ∙ by Urvashi Khandelwal, et al. ∙ 0 ∙ share

read it
BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension

We present BART, a denoising autoencoder for pretraining sequence-to-seq...
10/29/2019 ∙ by Mike Lewis, et al. ∙ 35 ∙ share

read it
RoBERTa: A Robustly Optimized BERT Pretraining Approach

Language model pretraining has led to significant performance gains but ...
07/26/2019 ∙ by Yinhan Liu, et al. ∙ 0 ∙ share

read it
MelNet: A Generative Model for Audio in the Frequency Domain

Capturing high-level structure in audio waveforms is challenging because...
06/04/2019 ∙ by Sean Vasquez, et al. ∙ 0 ∙ share

read it
Hierarchical Decision Making by Generating and Following Natural Language Instructions

We explore using latent natural language instructions as an expressive a...
06/03/2019 ∙ by Hengyuan Hu, et al. ∙ 4 ∙ share

read it
Improving Semantic Parsing for Task Oriented Dialog

Semantic parsing using hierarchical representations has recently been pr...
02/15/2019 ∙ by Arash Einolghozati, et al. ∙ 2 ∙ share

read it
Strategies for Structuring Story Generation

Writers generally rely on plans or sketches to write long stories, but m...
02/04/2019 ∙ by Angela Fan, et al. ∙ 0 ∙ share

read it
Cross-lingual Transfer Learning for Multilingual Task Oriented Dialog

One of the first steps in the utterance interpretation pipeline of many ...
10/31/2018 ∙ by Sebastian Schuster, et al. ∙ 0 ∙ share

read it
Semantic Parsing for Task Oriented Dialog using Hierarchical Representations

Task oriented dialog systems typically first parse user utterances to se...
10/18/2018 ∙ by Sonal Gupta, et al. ∙ 0 ∙ share

read it
Neural Compositional Denotational Semantics for Question Answering

Answering compositional questions requiring multi-step reasoning is chal...
08/29/2018 ∙ by Nitish Gupta, et al. ∙ 0 ∙ share

read it
Community Regularization of Visually-Grounded Dialog

The task of conducting visually grounded dialog involves learning goal-o...
08/10/2018 ∙ by Akshat Agarwal, et al. ∙ 0 ∙ share

read it
Hierarchical Neural Story Generation

We explore story generation: creative systems that can build coherent an...
05/13/2018 ∙ by Angela Fan, et al. ∙ 0 ∙ share

read it
Hierarchical Text Generation and Planning for Strategic Dialogue

End-to-end models for strategic dialogue are challenging to train, becau...
12/15/2017 ∙ by Denis Yarats, et al. ∙ 0 ∙ share

read it
End-to-end Neural Coreference Resolution

We introduce the first end-to-end coreference resolution model and show ...
07/21/2017 ∙ by Kenton Lee, et al. ∙ 0 ∙ share

read it
Deal or No Deal? End-to-End Learning for Negotiation Dialogues

Much of human dialogue occurs in semi-cooperative settings, where agents...
06/16/2017 ∙ by Mike Lewis, et al. ∙ 0 ∙ share

read it
Global Neural CCG Parsing with Optimality Guarantees

We introduce the first global recursive neural parsing model with optima...
07/05/2016 ∙ by Kenton Lee, et al. ∙ 0 ∙ share

read it

Mike Lewis

Featured Co-authors

Kyunghyun Cho

Devi Parikh

Dhruv Batra

Noah A. Smith

Luke Zettlemoyer

Sebastian Riedel

Florian Metze

Douwe Kiela

Dan Jurafsky

Tim Rocktäschel

Yuandong Tian

Shortformer: Better Language Modeling using Shorter Inputs

Joint Verification and Reranking for Open Fact Checking Over Tables

Nearest Neighbor Machine Translation

Conversational Semantic Parsing

Grounded Adaptation for Zero-shot Executable Semantic Parsing

Pre-training via Paraphrasing

Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks

Asking and Answering Questions to Evaluate the Factual Consistency of Summaries

Multilingual Denoising Pre-training for Neural Machine Translation

Enforcing Encoder-Decoder Modularity in Sequence-to-Sequence Models

Generalization through Memorization: Nearest Neighbor Language Models

BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension

RoBERTa: A Robustly Optimized BERT Pretraining Approach

MelNet: A Generative Model for Audio in the Frequency Domain

Hierarchical Decision Making by Generating and Following Natural Language Instructions

Improving Semantic Parsing for Task Oriented Dialog

Strategies for Structuring Story Generation

Cross-lingual Transfer Learning for Multilingual Task Oriented Dialog

Semantic Parsing for Task Oriented Dialog using Hierarchical Representations

Neural Compositional Denotational Semantics for Question Answering

Community Regularization of Visually-Grounded Dialog

Hierarchical Neural Story Generation

Hierarchical Text Generation and Planning for Strategic Dialogue

End-to-end Neural Coreference Resolution

Deal or No Deal? End-to-End Learning for Negotiation Dialogues

Global Neural CCG Parsing with Optimality Guarantees