Bridging Commonsense Reasoning and Probabilistic Planning via a Probabilistic Action Language

07/31/2019
by   Yi Wang, et al.
0

To be responsive to dynamically changing real-world environments, an intelligent agent needs to perform complex sequential decision-making tasks that are often guided by commonsense knowledge. The previous work on this line of research led to the framework called "interleaved commonsense reasoning and probabilistic planning" (icorpp), which used P-log for representing commmonsense knowledge and Markov Decision Processes (MDPs) or Partially Observable MDPs (POMDPs) for planning under uncertainty. A main limitation of icorpp is that its implementation requires non-trivial engineering efforts to bridge the commonsense reasoning and probabilistic planning formalisms. In this paper, we present a unified framework to integrate icorpp's reasoning and planning components. In particular, we extend probabilistic action language pBC+ to express utility, belief states, and observation as in POMDP models. Inheriting the advantages of action languages, the new action language provides an elaboration tolerant representation of POMDP that reflects commonsense knowledge. The idea led to the design of the system pbcplus2pomdp, which compiles a pBC+ action description into a POMDP model that can be directly processed by off-the-shelf POMDP solvers to compute an optimal policy of the pBC+ action description. Our experiments show that it retains the advantages of icorpp while avoiding the manual efforts in bridging the commonsense reasoner and the probabilistic planner.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/18/2020

iCORPP: Interleaved Commonsense Reasoning and Probabilistic Planning on Robots

Robot sequential decision-making in the real world is a challenge becaus...
research
04/01/2019

Elaboration Tolerant Representation of Markov Decision Process via Decision-Theoretic Extension of Probabilistic Action Language pBC+

We extend probabilistic action language pBC+ with the notion of utility ...
research
10/23/2022

Retrieval Augmentation for Commonsense Reasoning: A Unified Approach

A common thread of retrieval-augmented methods in the existing literatur...
research
05/23/2023

Large Language Models as Commonsense Knowledge for Large-Scale Task Planning

Natural language provides a natural interface for human communication, y...
research
01/16/2019

Robot Sequential Decision Making using LSTM-based Learning and Logical-probabilistic Reasoning

Sequential decision-making (SDM) plays a key role in intelligent robotic...
research
06/06/2022

Neuro-Symbolic Causal Language Planning with Commonsense Prompting

Language planning aims to implement complex high-level goals by decompos...
research
08/06/2016

COREALMLIB: An ALM Library Translated from the Component Library

This paper presents COREALMLIB, an ALM library of commonsense knowledge ...

Please sign up or login with your details

Forgot password? Click here to reset