
-
Shortformer: Better Language Modeling using Shorter Inputs
We explore the benefits of decreasing the input length of transformers. ...
read it
-
Joint Verification and Reranking for Open Fact Checking Over Tables
Structured information is an important knowledge source for automatic ve...
read it
-
Nearest Neighbor Machine Translation
We introduce k-nearest-neighbor machine translation (kNN-MT), which pred...
read it
-
Conversational Semantic Parsing
The structured representation for semantic parsing in task-oriented assi...
read it
-
Grounded Adaptation for Zero-shot Executable Semantic Parsing
We propose Grounded Adaptation for Zero-shot Executable Semantic Parsing...
read it
-
Pre-training via Paraphrasing
We introduce MARGE, a pre-trained sequence-to-sequence model learned wit...
read it
-
Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks
Large pre-trained language models have been shown to store factual knowl...
read it
-
Asking and Answering Questions to Evaluate the Factual Consistency of Summaries
Practical applications of abstractive summarization models are limited b...
read it
-
Multilingual Denoising Pre-training for Neural Machine Translation
This paper demonstrates that multilingual denoising pre-training produce...
read it
-
Enforcing Encoder-Decoder Modularity in Sequence-to-Sequence Models
Inspired by modular software design principles of independence, intercha...
read it
-
Generalization through Memorization: Nearest Neighbor Language Models
We introduce kNN-LMs, which extend a pre-trained neural language model (...
read it
-
BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension
We present BART, a denoising autoencoder for pretraining sequence-to-seq...
read it
-
RoBERTa: A Robustly Optimized BERT Pretraining Approach
Language model pretraining has led to significant performance gains but ...
read it
-
MelNet: A Generative Model for Audio in the Frequency Domain
Capturing high-level structure in audio waveforms is challenging because...
read it
-
Hierarchical Decision Making by Generating and Following Natural Language Instructions
We explore using latent natural language instructions as an expressive a...
read it
-
Improving Semantic Parsing for Task Oriented Dialog
Semantic parsing using hierarchical representations has recently been pr...
read it
-
Strategies for Structuring Story Generation
Writers generally rely on plans or sketches to write long stories, but m...
read it
-
Cross-lingual Transfer Learning for Multilingual Task Oriented Dialog
One of the first steps in the utterance interpretation pipeline of many ...
read it
-
Semantic Parsing for Task Oriented Dialog using Hierarchical Representations
Task oriented dialog systems typically first parse user utterances to se...
read it
-
Neural Compositional Denotational Semantics for Question Answering
Answering compositional questions requiring multi-step reasoning is chal...
read it
-
Community Regularization of Visually-Grounded Dialog
The task of conducting visually grounded dialog involves learning goal-o...
read it
-
Hierarchical Neural Story Generation
We explore story generation: creative systems that can build coherent an...
read it
-
Hierarchical Text Generation and Planning for Strategic Dialogue
End-to-end models for strategic dialogue are challenging to train, becau...
read it
-
End-to-end Neural Coreference Resolution
We introduce the first end-to-end coreference resolution model and show ...
read it
-
Deal or No Deal? End-to-End Learning for Negotiation Dialogues
Much of human dialogue occurs in semi-cooperative settings, where agents...
read it
-
Global Neural CCG Parsing with Optimality Guarantees
We introduce the first global recursive neural parsing model with optima...
read it