research
∙
11/03/2022
Circling Back to Recurrent Models of Language
Just because some purely recurrent models suffer from being hard to opti...
share
research
∙
09/26/2022
Two-Tailed Averaging: Anytime Adaptive Once-in-a-while Optimal Iterate Averaging for Stochastic Optimization
Tail averaging improves on Polyak averaging's non-asymptotic behaviour b...
research
∙
12/01/2020
Mutual Information Constraints for Monte-Carlo Objectives
A common failure mode of density models trained as variational autoencod...
research
∙
03/11/2020
Capturing document context inside sentence-level neural machine translation models with self-training
Neural machine translation (NMT) has arguably achieved human level parit...
research
∙
09/20/2019
A Critical Analysis of Biased Parsers in Unsupervised Parsing
A series of recent papers has used a parsing algorithm due to Shen et al...
research
∙
09/04/2019
Mogrifier LSTM
Many advances in Natural Language Processing have been based upon more e...
research
∙
04/07/2019
Unsupervised Recurrent Neural Network Grammars
Recurrent neural network grammars (RNNG) are generative models of langua...
research
∙
01/27/2019
Variational Smoothing in Recurrent Neural Network Language Models
We present a new theoretical perspective of data noising in recurrent ne...
research
∙
07/04/2018
Encoding Spatial Relations from Natural Language
Natural language processing has made significant inroads into learning t...
research
∙
05/23/2018
Pushing the bounds of dropout
We show that dropout training is best understood as performing MAP estim...
research
∙
12/19/2017
The NarrativeQA Reading Comprehension Challenge
Reading comprehension (RC)---in contrast to information retrieval---requ...
research
∙
07/18/2017
On the State of the Art of Evaluation in Neural Language Models
Ongoing innovations in recurrent neural network architectures have provi...
research
∙
09/29/2016