
Improving the Gating Mechanism of Recurrent Neural Networks
Gating mechanisms are widely used in neural network models, where they a...
read it

Making Efficient Use of Demonstrations to Solve Hard Exploration Problems
This paper introduces R2D3, an agent that makes efficient use of demonst...
read it

Stabilizing Transformers for Reinforcement Learning
Owing to their ability to both effectively integrate information over lo...
read it

Sample Efficient Adaptive TexttoSpeech
We present a metalearning approach for adaptive texttospeech (TTS) wi...
read it

Plan, Attend, Generate: Planning for SequencetoSequence Models
We investigate the integration of a planning mechanism into sequenceto...
read it

Mollifying Networks
The optimization of deep neural networks can be more challenging than tr...
read it

Dynamic Neural Turing Machine with Soft and Hard Addressing Schemes
We extend neural Turing machine (NTM) model into a dynamic neural Turing...
read it

Gated Orthogonal Recurrent Units: On Learning to Forget
We present a novel recurrent neural network (RNN) based model that combi...
read it

Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling
In this paper we compare different types of recurrent units in recurrent...
read it

Learning Phrase Representations using RNN EncoderDecoder for Statistical Machine Translation
In this paper, we propose a novel neural network model called RNN Encode...
read it

LearnedNorm Pooling for Deep Feedforward and Recurrent Neural Networks
In this paper we propose and investigate a novel nonlinear unit, called ...
read it

Memory Augmented Neural Networks with Wormhole Connections
Recent empirical results on longterm dependency tasks have shown that n...
read it

Noisy Activation Functions
Common nonlinear activation functions used in neural networks can cause ...
read it

Gated Feedback Recurrent Neural Networks
In this work, we propose a novel recurrent neural network (RNN) architec...
read it

ADASECANT: Robust Adaptive Secant Method for Stochastic Gradient
Stochastic gradient algorithms have been the main focus of largescale l...
read it

How to Construct Deep Recurrent Neural Networks
In this paper, we explore different ways to extend a recurrent neural ne...
read it

EmoNets: Multimodal deep learning approaches for emotion recognition in video
The task of the emotion recognition in the wild (EmotiW) Challenge is to...
read it

Knowledge Matters: Importance of Prior Information for Optimization
We explore the effect of introducing prior information into the intermed...
read it

Plan, Attend, Generate: Characterlevel Neural Machine Translation with Planning in the Decoder
We investigate the integration of a planning mechanism into an encoderd...
read it

Machine Comprehension by TexttoText Neural Question Generation
We propose a recurrent neural model that generates naturallanguage ques...
read it

Pointing the Unknown Words
The problem of rare and unknown words is an important issue that can pot...
read it

Generating Factoid Questions With Recurrent Neural Networks: The 30M Factoid QuestionAnswer Corpus
Over the past decade, largescale supervised learning corpora have enabl...
read it

Abstractive Text Summarization Using SequencetoSequence RNNs and Beyond
In this work, we model abstractive text summarization using Attentional ...
read it

On Using Monolingual Corpora in Neural Machine Translation
Recent work on endtoend neural networkbased architectures for machine...
read it

Relational inductive biases, deep learning, and graph networks
Artificial intelligence (AI) has undergone a renaissance recently, makin...
read it

Theano: A Python framework for fast computation of mathematical expressions
Theano is a Python library that allows to define, optimize, and evaluate...
read it

Hyperbolic Attention Networks
We introduce hyperbolic attention networks to endow neural networks with...
read it

Intrinsic Social Motivation via Causal Influence in MultiAgent RL
We derive a new intrinsic social motivation for multiagent reinforcemen...
read it

Social Influence as Intrinsic Motivation for MultiAgent Deep Reinforcement Learning
We propose a unified mechanism for achieving coordination and communicat...
read it