involve-MI: Informative Planning with High-Dimensional Non-Parametric Beliefs

09/23/2022
by   Gilad Rotman, et al.
0

One of the most complex tasks of decision making and planning is to gather information. This task becomes even more complex when the state is high-dimensional and its belief cannot be expressed with a parametric distribution. Although the state is high-dimensional, in many problems only a small fraction of it might be involved in transitioning the state and generating observations. We exploit this fact to calculate an information-theoretic expected reward, mutual information (MI), over a much lower-dimensional subset of the state, to improve efficiency and without sacrificing accuracy. A similar approach was used in previous works, yet specifically for Gaussian distributions, and we here extend it for general distributions. Moreover, we apply the dimensionality reduction for cases in which the new states are augmented to the previous, yet again without sacrificing accuracy. We then continue by developing an estimator for the MI which works in a Sequential Monte Carlo (SMC) manner, and avoids the reconstruction of future belief's surfaces. Finally, we show how this work is applied to the informative planning optimization problem. This work is then evaluated in a simulation of an active SLAM problem, where the improvement in both accuracy and timing is demonstrated.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/29/2021

Efficient Belief Space Planning in High-Dimensional State Spaces using PIVOT: Predictive Incremental Variable Ordering Tactic

In this work, we examine the problem of online decision making under unc...
research
09/19/2023

Measurement Simplification in ρ-POMDP with Performance Guarantees

Decision making under uncertainty is at the heart of any autonomous syst...
research
02/13/2023

Simplified Continuous High Dimensional Belief Space Planning with Adaptive Probabilistic Belief-dependent Constraints

Online decision making under uncertainty in partially observable domains...
research
05/29/2021

Simplified Belief-Dependent Reward MCTS Planning with Guaranteed Tree Consistency

Partially Observable Markov Decision Processes (POMDPs) are notoriously ...
research
09/02/2019

Efficient Decision Making and Belief Space Planning using Sparse Approximations

In this work, we introduce a new approach for the efficient solution of ...
research
09/28/2019

Dual Sequential Monte Carlo: Tunneling Filtering and Planning in Continuous POMDPs

We present the DualSMC network that solves continuous POMDPs by learning...
research
06/05/2019

General Purpose Incremental Covariance Update and Efficient Belief Space Planning via Factor-Graph Propagation Action Tree

Fast covariance calculation is required both for SLAM (e.g. in order to ...

Please sign up or login with your details

Forgot password? Click here to reset