research
∙
12/19/2022
DSI++: Updating Transformer Memory with New Documents
Differentiable Search Indices (DSIs) encode a corpus of documents in the...
share
research
∙
10/20/2022
Transcending Scaling Laws with 0.1
Scaling language models improves performance but comes with significant ...
research
∙
07/21/2022
Scaling Laws vs Model Architectures: How does Inductive Bias Influence Scaling?
There have been a lot of interest in the scaling properties of Transform...
research
∙
10/16/2021
Improving Compositional Generalization with Self-Training for Data-to-Text Generation
Data-to-text generation focuses on generating fluent natural language re...
research
∙
09/22/2021
Scale Efficiently: Insights from Pre-training and Fine-tuning Transformers
There remain many open questions pertaining to the scaling behaviour of ...
research
∙
11/08/2020
Long Range Arena: A Benchmark for Efficient Transformers
Transformers do not scale very well to long sequence lengths largely bec...
research
∙
06/17/2019
Constrained Decoding for Neural NLG from Compositional Representations in Task-Oriented Dialogue
Generating fluent natural language responses from structured semantic re...
research
∙
06/11/2019
Lightweight and Efficient Neural Natural Language Processing with Quaternion Networks
Many state-of-the-art neural models for NLP are heavily parameterized an...
research
∙
05/26/2019
Simple and Effective Curriculum Pointer-Generator Networks for Reading Comprehension over Long Narratives
This paper tackles the problem of reading comprehension over long narrat...
research
∙
11/02/2018
Simple Attention-Based Representation Learning for Ranking Short Social Media Posts
This paper explores the problem of ranking short social media posts with...
research
∙
05/21/2018
Multi-Perspective Relevance Matching with Hierarchical ConvNets for Social Media Search
Despite substantial interest in applications of neural networks to infor...
research
∙
07/25/2017
Exploring the Effectiveness of Convolutional Neural Networks for Answer Selection in End-to-End Question Answering
Most work on natural language question answering today focuses on answer...
research
∙
07/25/2017