Log In Sign Up

Replanning in Domains with Partial Information and Sensing Actions

by   Ronen I. Brafman, et al.

Replanning via determinization is a recent, popular approach for online planning in MDPs. In this paper we adapt this idea to classical, non-stochastic domains with partial information and sensing actions, presenting a new planner: SDR (Sample, Determinize, Replan). At each step we generate a solution plan to a classical planning problem induced by the original problem. We execute this plan as long as it is safe to do so. When this is no longer the case, we replan. The classical planning problem we generate is based on the translation-based approach for conformant planning introduced by Palacios and Geffner. The state of the classical planning problem generated in this approach captures the belief state of the agent in the original problem. Unfortunately, when this method is applied to planning problems with sensing, it yields a non-deterministic planning problem that is typically very large. Our main contribution is the introduction of state sampling techniques for overcoming these two problems. In addition, we introduce a novel, lazy, regression-based method for querying the agents belief state during run-time. We provide a comprehensive experimental evaluation of the planner, showing that it scales better than the state-of-the-art CLG planner on existing benchmark problems, but also highlighting its weaknesses with new domains. We also discuss its theoretical guarantees.


VHPOP: Versatile Heuristic Partial Order Planner

VHPOP is a partial order causal link (POCL) planner loosely based on UCP...

Efficient Planning under Partial Observability with Unnormalized Q Functions and Spectral Learning

Learning and planning in partially-observable domains is one of the most...

Proximity-Based Non-uniform Abstractions for Approximate Planning

In a deterministic world, a planning agent can be certain of the consequ...

Assumption-Based Planning

The purpose of the paper is to introduce a new approach of planning call...

Planning with External Events

I describe a planning methodology for domains with uncertainty in the fo...

A Critical Assessment of Benchmark Comparison in Planning

Recent trends in planning research have led to empirical comparison beco...

Task Scoping: Building Goal-Specific Abstractions for Planning in Complex Domains

A generally intelligent agent requires an open-scope world model: one ri...