research
∙
09/19/2023
Language Modeling Is Compression
It has long been established that predictive models can be transformed i...
share
research
∙
05/26/2023
Randomized Positional Encodings Boost Length Generalization of Transformers
Transformers have impressive generalization capabilities on tasks with a...
research
∙
02/06/2023
Memory-Based Meta-Learning on Non-Stationary Distributions
Memory-based meta-learning is a technique for approximating Bayes-optima...
research
∙
09/30/2022
Beyond Bayes-optimality: meta-learning what you know you don't know
Meta-training agents with memory has been shown to culminate in Bayes-op...
research
∙
07/05/2022
Neural Networks and the Chomsky Hierarchy
Reliable generalization lies at the heart of safe ML and AI. However, un...
research
∙
03/23/2022
Your Policy Regularizer is Secretly an Adversary
Policy regularization methods such as maximum entropy regularization are...
research
∙
11/04/2021
Model-Free Risk-Sensitive Reinforcement Learning
We extend temporal-difference (TD) learning in order to obtain risk-sens...
research
∙
10/20/2021
Shaking the foundations: delusions in sequence models for interaction and control
The recent phenomenal success of language models has reinvigorated machi...
research
∙
03/05/2021
Causal Analysis of Agent Behavior for AI Safety
As machine learning systems become more powerful they also become increa...
research
∙
10/23/2020
Algorithms for Causal Reasoning in Probability Trees
Probability trees are one of the simplest models of causal generative pr...
research
∙
10/21/2020