RAPID: A Reachable Anytime Planner for Imprecisely-sensed Domains

by   Emma Brunskill, et al.

Despite the intractability of generic optimal partially observable Markov decision process planning, there exist important problems that have highly structured models. Previous researchers have used this insight to construct more efficient algorithms for factored domains, and for domains with topological structure in the flat state dynamics model. In our work, motivated by findings from the education community relevant to automated tutoring, we consider problems that exhibit a form of topological structure in the factored dynamics model. Our Reachable Anytime Planner for Imprecisely-sensed Domains (RAPID) leverages this structure to efficiently compute a good initial envelope of reachable states under the optimal MDP policy in time linear in the number of state variables. RAPID performs partially-observable planning over the limited envelope of states, and slowly expands the state space considered as time allows. RAPID performs well on a large tutoring-inspired problem simulation with 122 state variables, corresponding to a flat state space of over 10^30 states.



There are no comments yet.


page 1

page 2

page 3

page 4


Improving Automated Driving through Planning with Human Internal States

This work examines the hypothesis that partially observable Markov decis...

POMDP-lite for Robust Robot Planning under Uncertainty

The partially observable Markov decision process (POMDP) provides a prin...

Region-Based Approximations for Planning in Stochastic Domains

This paper is concerned with planning in stochastic domains by means of ...

Partially Observable Planning and Learning for Systems with Non-Uniform Dynamics

We propose a neural network architecture, called TransNet, that combines...

A Heuristic Search Approach to Planning with Continuous Resources in Stochastic Domains

We consider the problem of optimal planning in stochastic domains with r...

Topological Value Iteration Algorithms

Value iteration is a powerful yet inefficient algorithm for Markov decis...

Proximity-Based Non-uniform Abstractions for Approximate Planning

In a deterministic world, a planning agent can be certain of the consequ...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.