Identifying Optimal Sequential Decisions

06/13/2012
by   Philip Dawid, et al.
0

We consider conditions that allow us to find an optimal strategy for sequential decisions from a given data situation. For the case where all interventions are unconditional (atomic), identifiability has been discussed by Pearl & Robins (1995). We argue here that an optimal strategy must be conditional, i.e. take the information available at each decision point into account. We show that the identification of an optimal sequential decision strategy is more restrictive, in the sense that conditional interventions might not always be identified when atomic interventions are. We further demonstrate that a simple graphical criterion for the identifiability of an optimal strategy can be given.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/26/2023

Causal Bandits without Graph Learning

We study the causal bandit problem when the causal graph is unknown and ...
research
11/09/2021

Almost Optimal Universal Lower Bound for Learning Causal DAGs with Atomic Interventions

A well-studied challenge that arises in the structure learning problem o...
research
04/23/2023

Bridging Declarative, Procedural, and Conditional Metacognitive Knowledge Gap Using Deep Reinforcement Learning

In deductive domains, three metacognitive knowledge types in ascending o...
research
12/07/2020

Algebraic geometry of discrete interventional models

We investigate the algebra and geometry of general interventions in disc...
research
06/06/2021

Collaborative Causal Discovery with Atomic Interventions

We introduce a new Collaborative Causal Discovery problem, through which...
research
07/30/2019

Effects of interventions and optimal strategies in the stochastic system approach to causality

We consider the problem of defining the effect of an intervention on a t...
research
12/12/2012

Unconstrained Influence Diagrams

We extend the language of influence diagrams to cope with decision scena...

Please sign up or login with your details

Forgot password? Click here to reset