
Action and Perception as Divergence Minimization
We introduce a unified objective for action and perception of intelligen...
read it

A Study of Gradient Variance in Deep Learning
The impact of gradient noise on training deep models is widely acknowled...
read it

The Scattering Compositional Learner: Discovering Objects, Attributes, Relationships in Analogical Reasoning
In this work, we focus on an analogical reasoning task that contains ric...
read it

INT: An Inequality Benchmark for Evaluating Generalization in Theorem Proving
In learningassisted theorem proving, one of the most critical challenge...
read it

Maximum Entropy Gain Exploration for Long Horizon Multigoal Reinforcement Learning
What goals should a multigoal reinforcement learning agent pursue durin...
read it

When Does Preconditioning Help or Hurt Generalization?
While second order optimizers such as natural gradient descent (NGD) oft...
read it

BatchEnsemble: an Alternative Approach to Efficient Ensemble and Lifelong Learning
Ensembles, where multiple neural networks are trained individually and t...
read it

An Inductive Bias for Distances: Neural Nets that Respect the Triangle Inequality
Distances are pervasive in machine learning. They serve as similarity me...
read it

Dream to Control: Learning Behaviors by Latent Imagination
Learned world models summarize an agent's experience to facilitate learn...
read it

On Solving Minimax Optimization Locally: A FollowtheRidge Approach
Many tasks in modern machine learning can be formulated as finding equil...
read it

Lookahead Optimizer: k steps forward, 1 step back
The vast majority of successful deep neural networks are trained using v...
read it

Benchmarking ModelBased Reinforcement Learning
Modelbased reinforcement learning (MBRL) is widely seen as having the p...
read it

Exploring Modelbased Planning with Policy Networks
Modelbased reinforcement learning (MBRL) with modelpredictive control ...
read it

Neural Graph Evolution: Towards Efficient Automatic Robot Design
Despite the recent successes in robotic locomotion control, the design o...
read it

Graph Normalizing Flows
We introduce graph normalizing flows: a new, reversible graph neural net...
read it

Interplay Between Optimization and Generalization of Stochastic Gradient Descent with Covariance Noise
The choice of batchsize in a stochastic optimization algorithm plays a ...
read it

DOMQNET: Grounded RL on Structured Language
Building agents to interact with the web would allow for significant imp...
read it

ACTRCE: Augmenting Experience via Teacher's Advice For MultiGoal Reinforcement Learning
Sparse reward is one of the most challenging problems in reinforcement l...
read it

Reversible Recurrent Neural Networks
Recurrent neural networks (RNNs) provide stateoftheart performance in...
read it

Flipout: Efficient PseudoIndependent Weight Perturbations on MiniBatches
Stochastic neural net weights are used in a variety of contexts, includi...
read it

Solving Approximate Wasserstein GANs to Stationarity
Generative Adversarial Networks (GANs) are one of the most practical str...
read it

Scalable trustregion method for deep reinforcement learning using Kroneckerfactored approximation
In this work, we propose to apply trust region optimization to deep rein...
read it

Using Fast Weights to Attend to the Recent Past
Until recently, research on artificial neural networks was largely restr...
read it

Learning WakeSleep Recurrent Attention Models
Despite their success, convolutional neural networks are computationally...
read it

Predicting Deep ZeroShot Convolutional Neural Networks using Textual Descriptions
One of the main challenges in ZeroShot Learning of visual categories is...
read it

Show, Attend and Tell: Neural Image Caption Generation with Visual Attention
Inspired by recent work in machine translation and object detection, we ...
read it

Multiple Object Recognition with Visual Attention
We present an attentionbased model for recognizing multiple objects in ...
read it
Jimmy Ba
is this you? claim profile