Before we can find a model, we must forget about perfection

12/10/2019
by   Dimiter Dobrev, et al.
0

With Reinforcement Learning we assume that a model of the world does exist. We assume furthermore that the model in question is perfect (i.e. it describes the world completely and unambiguously). This article will demonstrate that it does not make sense to search for the perfect model because this model is too complicated and practically impossible to find. We will show that we should abandon the pursuit of perfection and pursue Event-Driven (ED) models instead. These models are generalization of Markov Decision Process (MDP) models. This generalization is essential because nothing can be found without it. Rather than a single MDP, we will aim to find a raft of neat simple ED models each one describing a simple dependency or property. In other words, we will replace the search for a singular and complex perfect model with a search for a large number of simple models.

READ FULL TEXT
research
06/24/2019

Event-Driven Models

In Reinforcement Learning we look for meaning in the flow of input/outpu...
research
08/18/2020

A Relation Analysis of Markov Decision Process Frameworks

We study the relation between different Markov Decision Process (MDP) fr...
research
06/20/2017

Robust and Efficient Transfer Learning with Hidden-Parameter Markov Decision Processes

We introduce a new formulation of the Hidden Parameter Markov Decision P...
research
11/17/2020

REALab: An Embedded Perspective on Tampering

This paper describes REALab, a platform for embedded agency research in ...
research
07/12/2012

Learning Diagnostic Policies from Examples by Systematic Search

A diagnostic policy specifies what test to perform next, based on the re...
research
04/20/2020

Data-Driven Learning and Load Ensemble Control

Demand response (DR) programs aim to engage distributed small-scale flex...
research
09/10/2020

A Markov Decision Process Approach to Active Meta Learning

In supervised learning, we fit a single statistical model to a given dat...

Please sign up or login with your details

Forgot password? Click here to reset