Utilization of domain knowledge to improve POMDP belief estimation

02/17/2023
by   Tung Nguyen, et al.
0

The partially observable Markov decision process (POMDP) framework is a common approach for decision making under uncertainty. Recently, multiple studies have shown that by integrating relevant domain knowledge into POMDP belief estimation, we can improve the learned policy's performance. In this study, we propose a novel method for integrating the domain knowledge into probabilistic belief update in POMDP framework using Jeffrey's rule and normalization. We show that the domain knowledge can be utilized to reduce the data requirement and improve performance for POMDP policy learning with RL.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/16/2021

Transferring Domain Knowledge with an Adviser in Continuous Tasks

Recent advances in Reinforcement Learning (RL) have surpassed human-leve...
research
05/09/2012

Domain Knowledge Uncertainty and Probabilistic Parameter Constraints

Incorporating domain knowledge into the modeling process is an effective...
research
05/23/2022

Flow-based Recurrent Belief State Learning for POMDPs

Partially Observable Markov Decision Process (POMDP) provides a principl...
research
01/16/2013

Value-Directed Belief State Approximation for POMDPs

We consider the problem belief-state monitoring for the purposes of impl...
research
07/29/2013

Combining Answer Set Programming and POMDPs for Knowledge Representation and Reasoning on Mobile Robots

For widespread deployment in domains characterized by partial observabil...
research
01/25/2011

A Generalized Method for Integrating Rule-based Knowledge into Inductive Methods Through Virtual Sample Creation

Hybrid learning methods use theoretical knowledge of a domain and a set ...
research
06/29/2018

Knowledge-Based Distant Regularization in Learning Probabilistic Models

Exploiting the appropriate inductive bias based on the knowledge of data...

Please sign up or login with your details

Forgot password? Click here to reset