Simplified Continuous High Dimensional Belief Space Planning with Adaptive Probabilistic Belief-dependent Constraints

02/13/2023
by   Andrey Zhitnikov, et al.
0

Online decision making under uncertainty in partially observable domains, also known as Belief Space Planning, is a fundamental problem in robotics and Artificial Intelligence. Due to an abundance of plausible future unravelings, calculating an optimal course of action inflicts an enormous computational burden on the agent. Moreover, in many scenarios, e.g., information gathering, it is required to introduce a belief-dependent constraint. Prompted by this demand, in this paper, we consider a recently introduced probabilistic belief-dependent constrained POMDP. We present a technique to adaptively accept or discard a candidate action sequence with respect to a probabilistic belief-dependent constraint, before expanding a complete set of future observations samples and without any loss in accuracy. Moreover, using our proposed framework, we contribute an adaptive method to find a maximal feasible return (e.g., information gain) in terms of Value at Risk for the candidate action sequence with substantial acceleration. On top of that, we introduce an adaptive simplification technique for a probabilistically constrained setting. Such an approach provably returns an identical-quality solution while dramatically accelerating online decision making. Our universal framework applies to any belief-dependent constrained continuous POMDP with parametric beliefs, as well as nonparametric beliefs represented by particles. In the context of an information-theoretic constraint, our presented framework stochastically quantifies if a cumulative information gain along the planning horizon is sufficiently significant (e.g. for, information gathering, active SLAM). We apply our method to active SLAM, a highly challenging problem of high dimensional Belief Space Planning. Extensive realistic simulations corroborate the superiority of our proposed ideas.

READ FULL TEXT
research
09/06/2022

Risk Aware Belief-dependent Constrained POMDP Planning

Risk awareness is fundamental to an online operating agent. However, it ...
research
09/02/2019

Efficient Decision Making and Belief Space Planning using Sparse Approximations

In this work, we introduce a new approach for the efficient solution of ...
research
02/18/2021

iX-BSP: Incremental Belief Space Planning

Deciding what's next? is a fundamental problem in robotics and Artificia...
research
03/03/2019

Topological Information-Theoretic Belief Space Planning with Optimality Guarantees

Determining a globally optimal solution of belief space planning (BSP) i...
research
09/23/2022

involve-MI: Informative Planning with High-Dimensional Non-Parametric Beliefs

One of the most complex tasks of decision making and planning is to gath...
research
05/11/2021

Online POMDP Planning via Simplification

In this paper, we consider online planning in partially observable domai...
research
05/12/2021

Probabilistic Loss and its Online Characterization for Simplified Decision Making Under Uncertainty

It is a long-standing objective to ease the computation burden incurred ...

Please sign up or login with your details

Forgot password? Click here to reset