Domain Concretization from Examples: Addressing Missing Domain Knowledge via Robust Planning

11/18/2020
by   Akshay Sharma, et al.
0

The assumption of complete domain knowledge is not warranted for robot planning and decision-making in the real world. It could be due to design flaws or arise from domain ramifications or qualifications. In such cases, existing planning and learning algorithms could produce highly undesirable behaviors. This problem is more challenging than partial observability in the sense that the agent is unaware of certain knowledge, in contrast to it being partially observable: the difference between known unknowns and unknown unknowns. In this work, we formulate it as the problem of Domain Concretization, an inverse problem to domain abstraction. Based on an incomplete domain model provided by the designer and teacher traces from human users, our algorithm searches for a candidate model set under a minimalistic model assumption. It then generates a robust plan with the maximum probability of success under the set of candidate models. In addition to a standard search formulation in the model-space, we propose a sample-based search method and also an online version of it to improve search time. We tested our approach on IPC domains and a simulated robotics domain where incompleteness was introduced by removing domain features from the complete model. Results show that our planning algorithm increases the plan success rate without impacting the cost much.

READ FULL TEXT

page 1

page 3

page 9

research
07/28/2012

Model-Lite Case-Based Planning

There is increasing awareness in the planning community that depending o...
research
12/12/2012

Reinforcement Learning with Partially Known World Dynamics

Reinforcement learning would enjoy better success on real-world problems...
research
08/26/2019

Learning Action Models from Disordered and Noisy Plan Traces

There is increasing awareness in the planning community that the burden ...
research
04/19/2018

An Integrated Development Environment for Planning Domain Modeling

In order to make the task, description of planning domains and problems,...
research
06/24/2022

RAPid-Learn: A Framework for Learning to Recover for Handling Novelties in Open-World Environments

We propose RAPid-Learn: Learning to Recover and Plan Again, a hybrid pla...
research
11/29/2019

Refining HTN Methods via Task Insertion with Preferences

Hierarchical Task Network (HTN) planning is showing its power in real-wo...
research
05/27/2019

Value Iteration Networks on Multiple Levels of Abstraction

Learning-based methods are promising to plan robot motion without perfor...

Please sign up or login with your details

Forgot password? Click here to reset