research
∙
06/26/2023
Scalable Neural Contextual Bandit for Recommender Systems
High-quality recommender systems ought to deliver both innovative and re...
share
research
∙
05/19/2023
Shattering the Agent-Environment Interface for Fine-Tuning Inclusive Language Models
A centerpiece of the ever-popular reinforcement learning from human feed...
research
∙
05/05/2023
Bayesian Reinforcement Learning with Limited Cognitive Load
All biological and artificial agents must learn and make decisions given...
research
∙
02/23/2023
A Definition of Non-Stationary Bandits
The subject of non-stationary bandit learning has attracted much recent ...
research
∙
02/18/2023
Approximate Thompson Sampling via Epistemic Neural Networks
Thompson sampling (TS) is a popular heuristic for action selection, but ...
research
∙
02/07/2023
Leveraging Demonstrations to Improve Online Learning: Quality Matters
We investigate the extent to which offline demonstration data can improv...
research
∙
12/24/2022
Inclusive Artificial Intelligence
Prevailing methods for assessing and comparing generative AIs incentiviz...
research
∙
12/02/2022
An Information-Theoretic Analysis of Compute-Optimal Neural Scaling Laws
We study the compute-optimal trade-off between model and training data s...
research
∙
11/29/2022
Posterior Sampling for Continuing Environments
We develop an extension of posterior sampling for reinforcement learning...
research
∙
11/03/2022
Fine-Tuning Language Models via Epistemic Neural Networks
Large language models are now part of a powerful new paradigm in machine...
research
∙
10/30/2022
On Rate-Distortion Theory in Capacity-Limited Cognition Reinforcement Learning
Throughout the cognitive-science literature, there is widespread agreeme...
research
∙
09/18/2022
Is Stochastic Gradient Descent Near Optimal?
The success of neural networks over the past decade has established them...
research
∙
07/01/2022
Robustness of Epinets against Distributional Shifts
Recent work introduced the epinet as a new approach to uncertainty model...
research
∙
06/08/2022
Ensembles for Uncertainty Estimation: Benefits of Prior Functions and Bootstrapping
In machine learning, an agent needs to estimate uncertainty to efficient...
research
∙
06/04/2022
Deciding What to Model: Value-Equivalent Sampling for Reinforcement Learning
The quintessential model-based reinforcement-learning agent iteratively ...
research
∙
06/04/2022
Between Rate-Distortion Theory Value Equivalence in Model-Based Reinforcement Learning
The quintessential model-based reinforcement-learning agent iteratively ...
research
∙
05/04/2022
Nonstationary Bandit Learning via Predictive Sampling
We propose predictive sampling as an approach to selecting actions that ...
research
∙
03/02/2022
An Analysis of Ensemble Sampling
Ensemble sampling serves as a practical approximation to Thompson sampli...
research
∙
03/01/2022
Sample Complexity versus Depth: An Information Theoretic Analysis
Deep learning has proven effective across a range of data sets. In light...
research
∙
02/28/2022
Evaluating High-Order Predictive Distributions in Deep Learning
Most work on supervised learning research has focused on marginal predic...
research
∙
01/06/2022
Gaussian Imagination in Bandit Learning
Assuming distributions are Gaussian often facilitates computations that ...
research
∙
10/26/2021
The Value of Information When Deciding What to Learn
All sequential decision-making agents explore so as to acquire knowledge...
research
∙
10/09/2021
Evaluating Predictive Distributions: Does Bayesian Deep Learning Work?
Posterior predictive distributions quantify uncertainties ignored by poi...
research
∙
09/26/2021
Deep Exploration for Recommendation Systems
We investigate the design of recommendation systems that can efficiently...
research
∙
07/20/2021
Evaluating Probabilistic Inference in Deep Learning: Beyond Marginal Predictions
A fundamental challenge for any intelligent system is prediction: given ...
research
∙
07/19/2021
Epistemic Neural Networks
We introduce the epistemic neural network (ENN) as an interface for unce...
research
∙
03/06/2021
Reinforcement Learning, Bit by Bit
Reinforcement learning agents have demonstrated remarkable achievements ...
research
∙
02/18/2021
A Bit Better? Quantifying Information for Bandit Learning
The information ratio offers an approach to assessing the efficacy with ...
research
∙
02/10/2021
Simple Agent, Complex Environment: Efficient Reinforcement Learning with Agent State
We design a simple reinforcement learning agent that, with a specificati...
research
∙
01/15/2021
Deciding What to Learn: A Rate-Distortion Approach
Agents that learn to select optimal actions represent a prominent focus ...
research
∙
10/05/2020
Randomized Value Functions via Posterior State-Abstraction Sampling
State abstraction has been an essential tool for dramatically improving ...
research
∙
06/12/2020
Hypermodels for Exploration
We study the use of hypermodels to represent epistemic uncertainty and g...
research
∙
02/17/2020
Langevin DQN
Algorithms that tackle deep exploration – an important challenge in rein...
research
∙
12/13/2019
Provably Efficient Reinforcement Learning with Aggregated States
We establish that an optimistic variant of Q-learning applied to a finit...
research
∙
11/21/2019
Information-Theoretic Confidence Bounds for Reinforcement Learning
We integrate information-theoretic concepts into the design and analysis...
research
∙
11/18/2019
Comments on the Du-Kakade-Wang-Yang Lower Bounds
Du, Kakade, Wang, and Yang recently established intriguing lower bounds ...
research
∙
08/09/2019
Behaviour Suite for Reinforcement Learning
This paper introduces the Behaviour Suite for Reinforcement Learning, or...
research
∙
05/12/2019
On the Performance of Thompson Sampling on Logistic Bandits
We study the logistic bandit, in which rewards are binary with success p...
research
∙
05/30/2018
An Information-Theoretic Analysis for Thompson Sampling with Many Actions
Information-theoretic Bayesian regret bounds of Russo and Van Roy captur...
research
∙
05/30/2018
An Information-Theoretic Analysis of Thompson Sampling for Large Action Spaces
Information-theoretic Bayesian regret bounds of Russo and Van Roy captur...
research
∙
05/23/2018
Scalable Coordinated Exploration in Concurrent Reinforcement Learning
We consider a team of reinforcement learning agents that concurrently op...
research
∙
03/07/2018
Satisficing in Time-Sensitive Bandit Learning
Much of the recent literature on bandit learning focuses on algorithms t...
research
∙
02/05/2018
Coordinated Exploration in Concurrent Reinforcement Learning
We consider a team of reinforcement learning agents that concurrently le...
research
∙
08/29/2017
Learning to Price with Reference Effects
As a firm varies the price of a product, consumers exhibit reference eff...
research
∙
06/13/2017
On Optimistic versus Randomized Exploration in Reinforcement Learning
We discuss the relative merits of optimistic and randomized approaches t...
research
∙
05/20/2017
Ensemble Sampling
Thompson sampling has emerged as an effective heuristic for a broad rang...
research
∙
03/22/2017
Deep Exploration via Randomized Value Functions
We study the use of randomized value functions to guide deep exploration...
research
∙
02/14/2017
Gaussian-Dirichlet Posterior Dominance in Sequential Learning
We consider the problem of sequential learning from categorical observat...
research
∙
11/19/2016
Conservative Contextual Linear Bandits
Safety is a desirable property that can immensely increase the applicabi...
research
∙
08/09/2016