research
∙
06/05/2023
Has the Machine Learning Review Process Become More Arbitrary as the Field Has Grown? The NeurIPS 2021 Consistency Experiment
We present the NeurIPS 2021 consistency experiment, a larger-scale varia...
share
research
∙
02/17/2023
SAM operates far from home: eigenvalue regularization as a dynamical phenomenon
The Sharpness Aware Minimization (SAM) optimization algorithm has been s...
research
∙
11/22/2022
How do Authors' Perceptions of their Papers Compare with Co-authors' Perceptions and Peer-review Decisions?
How do author perceptions match up to the outcomes of the peer-review pr...
research
∙
08/15/2019
Simple and Effective Noisy Channel Modeling for Neural Machine Translation
Previous work on neural noisy channel modeling relied on latent variable...
research
∙
01/29/2019
Pay Less Attention with Lightweight and Dynamic Convolutions
Self-attention is a useful mechanism to build generative models for lang...
research
∙
01/27/2019
Fixup Initialization: Residual Learning Without Normalization
Normalization layers are a staple in state-of-the-art deep neural networ...
research
∙
10/25/2017
mixup: Beyond Empirical Risk Minimization
Large deep neural networks are powerful, but exhibit undesirable behavio...
research
∙
06/16/2017
Deal or No Deal? End-to-End Learning for Negotiation Dialogues
Much of human dialogue occurs in semi-cooperative settings, where agents...
research
∙
05/08/2017
Convolutional Sequence to Sequence Learning
The prevalent approach to sequence to sequence learning maps an input se...
research
∙
12/23/2016
Language Modeling with Gated Convolutional Networks
The pre-dominant approach to language modeling to date is based on recur...
research
∙
11/07/2016
A Convolutional Encoder Model for Neural Machine Translation
The prevalent approach to neural machine translation relies on bi-direct...
research
∙
05/09/2016
Theano: A Python framework for fast computation of mathematical expressions
Theano is a Python library that allows to define, optimize, and evaluate...
research
∙
02/15/2015
Equilibrated adaptive learning rates for non-convex optimization
Parameter-specific adaptive learning rate methods are computationally ef...
research
∙
05/19/2014
On the saddle point problem for non-convex optimization
A central challenge to many fields of science and engineering involves m...
research
∙
01/16/2013