
Fast Adaptation via PolicyDynamics Value Functions
Standard RL algorithms assume fixed environment dynamics and require a s...
read it

OpenDomain Conversational Agents: Current Progress, Open Problems, and Future Directions
We present our view of what is necessary to build an engaging opendomai...
read it

Residual EnergyBased Models for Text Generation
Text generation is ubiquitous in many NLP tasks, from summarization, to ...
read it

Learning to Visually Navigate in Photorealistic Environments Without any Supervision
Learning to navigate in a realistic setting where an agent must rely sol...
read it

I love your chain mail! Making knights smile in a fantasy game world: Opendomain goaloriented dialogue agents
Dialogue research tends to distinguish between chitchat and goalorient...
read it

I love your chain mail! Making knights smile in a fantasy game world: Opendomain goalorientated dialogue agents
Dialogue research tends to distinguish between chitchat and goalorient...
read it

Generating Interactive Worlds with Text
Procedurally generating cohesive and interesting game environments is ch...
read it

Why Build an Assistant in Minecraft?
In this document we describe a rationale for a research program aimed at...
read it

CraftAssist: A Framework for Dialogueenabled Interactive Agents
This paper describes an implementation of a bot assistant in Minecraft, ...
read it

Real or Fake? Learning to Discriminate Machine from Human Generated Text
Recent advances in generative modeling of text have demonstrated remarka...
read it

CraftAssist Instruction Parsing: Semantic Parsing for a Minecraft Assistant
We propose a large scale semantic parsing dataset focused on instruction...
read it

Learning to Speak and Act in a Fantasy Text Adventure Game
We introduce a large scale crowdsourced text adventure game as a researc...
read it

The Second Conversational Intelligence Challenge (ConvAI2)
We describe the setting and results of the ConvAI2 NeurIPS competition t...
read it

Learning Goal Embeddings via SelfPlay for Hierarchical Reinforcement Learning
In hierarchical reinforcement learning a major challenge is determining ...
read it

Dialogue Natural Language Inference
Consistency is a long standing issue faced by dialogue models. In this p...
read it

Planning with Arithmetic and Geometric Attributes
A desirable property of an intelligent agent is its ability to understan...
read it

Lightweight Adaptive Mixture of Neural and Ngram Language Models
It is often the case that the best performing language model is an ensem...
read it

Composable Planning with Attributes
The tasks that an agent will need to solve often are not known during tr...
read it

Modeling Others using Oneself in MultiAgent Reinforcement Learning
We consider the multiagent reinforcement learning setting with imperfec...
read it

Personalizing Dialogue Agents: I have a dog, do you have pets too?
Chitchat models are known to have several problems: they lack specifici...
read it

Mastering the Dungeon: Grounded Language Learning by Mechanical Turker Descent
Contrary to most natural language processing research, which makes use o...
read it

Optimizing the Latent Space of Generative Networks
Generative Adversarial Networks (GANs) have been shown to be able to sam...
read it

Lowshot learning with largescale diffusion
This paper considers the problem of inferring image labels for which onl...
read it

Hard Mixtures of Experts for Large Scale Weakly Supervised Vision
Training convolutional networks (CNN's) that fit on a single GPU with mi...
read it

Training Language Models Using TargetPropagation
While Truncated BackPropagation through Time (BPTT) is the most popular...
read it

Automatic Rule Extraction from Long Short Term Memory Networks
Although deep learning models have proven effective at solving problems ...
read it

TransformationBased Models of Video Sequences
In this work we propose a simple unsupervised approach for next frame pr...
read it

Tracking the World State with Recurrent Entity Networks
We introduce a new model, the Recurrent Entity Network (EntNet). It is e...
read it

Geometric deep learning: going beyond Euclidean data
Many scientific fields study data with an underlying structure that is a...
read it

Recurrent Orthogonal Networks and LongMemory Tasks
Although RNNs have been shown to be powerful tools for processing sequen...
read it

Simple Baseline for Visual Question Answering
We describe a very simple bagofwords baseline for visual question answ...
read it

MazeBase: A Sandbox for Learning from Games
This paper introduces MazeBase: an environment for simple 2D games, desi...
read it

Evaluating Prerequisite Qualities for Learning EndtoEnd Dialog Systems
A longterm goal of machine learning is to build intelligent conversatio...
read it

Convolutional networks and learning invariant to homogeneous multiplicative scalings
The conventional classification schemes  notably multinomial logistic ...
read it

Deep Generative Image Models using a Laplacian Pyramid of Adversarial Networks
In this paper we introduce a generative parametric model capable of prod...
read it

EndToEnd Memory Networks
We introduce a neural network with a recurrent attention model over a po...
read it

A mathematical motivation for complexvalued convolutional networks
A complexvalued convolutional network (convnet) implements the repeated...
read it

Video (language) modeling: a baseline for generative models of natural videos
We propose a strong baseline model for unsupervised feature learning usi...
read it

Better Feature Tracking Through Subspace Constraints
Feature tracking in video is a crucial task in computer vision. Usually,...
read it

Spectral Networks and Locally Connected Networks on Graphs
Convolutional Neural Networks are extremely efficient architectures in i...
read it

Unsupervised Feature Learning by Deep Sparse Coding
In this paper, we propose a new unsupervised feature learning framework,...
read it

Signal Recovery from Pooling Representations
In this work we compute lower Lipschitz bounds of ℓ_p pooling operators ...
read it

Tree structured sparse coding on cubes
A brief description of tree structured sparse coding on the binary cube....
read it

Learning Stable Group Invariant Representations with Convolutional Networks
Transformation groups, such as translations or rotations, effectively ex...
read it

Fast approximations to structured sparse coding and applications to object classification
We describe a method for fast approximation of sparse coding. The input ...
read it

Hybrid Linear Modeling via Local Bestfit Flats
We present a simple and fast geometric method for modeling data by a uni...
read it

Convolutional Matching Pursuit and Dictionary Training
Matching pursuit and KSVD is demonstrated in the translation invariant ...
read it

Randomized hybrid linear modeling by local bestfit flats
The hybrid linear modeling problem is to identify a set of ddimensional...
read it

Median Kflats for hybrid linear modeling with many outliers
We describe the Median KFlats (MKF) algorithm, a simple online method f...
read it