Asymptotically Optimal Belief Space Planning in Discrete Partially-Observable Domains

09/19/2023
by   Janis Eric Freund, et al.
0

Robots often have to operate in discrete partially observable worlds, where the states of world are only observable at runtime. To react to different world states, robots need contingencies. However, computing contingencies is costly and often non-optimal. To address this problem, we develop the improved path tree optimization (PTO) method. PTO computes motion contingencies by constructing a tree of motion paths in belief space. This is achieved by constructing a graph of configurations, then adding observation edges to extend the graph to belief space. Afterwards, we use a dynamic programming step to extract the path tree. PTO extends prior work by adding a camera-based state sampler to improve the search for observation points. We also add support to non-euclidean state spaces, provide an implementation in the open motion planning library (OMPL), and evaluate PTO on four realistic scenarios with a virtual camera in up to 10-dimensional state spaces. We compare PTO with a default and with the new camera-based state sampler. The results indicate that the camera-based state sampler improves success rates in 3 out of 4 scenarios while having a significant lower memory footprint. This makes PTO an important contribution to advance the state-of-the-art for discrete belief space planning.

READ FULL TEXT

page 1

page 5

research
04/09/2022

Path-Tree Optimization in Partially Observable Environments using Rapidly-Exploring Belief-Space Graphs

Robots often need to solve path planning problems where essential and di...
research
08/27/2019

Task-assisted Motion Planning in Partially Observable Domains

We present an integrated Task-Motion Planning framework for robot naviga...
research
12/14/2019

PODDP: Partially Observable Differential Dynamic Programming for Latent Belief Space Planning

Autonomous agents are limited in their ability to observe the world stat...
research
11/04/2020

An On-Line POMDP Solver for Continuous Observation Spaces

Planning under partial obervability is essential for autonomous robots. ...
research
09/25/2021

Improved Soft Duplicate Detection in Search-Based Motion Planning

Search-based techniques have shown great success in motion planning prob...
research
05/24/2021

Belief Space Planning: A Covariance Steering Approach

A new belief space planning algorithm, called covariance steering Belief...
research
05/10/2019

Memory Bounded Open-Loop Planning in Large POMDPs using Thompson Sampling

State-of-the-art approaches to partially observable planning like POMCP ...

Please sign up or login with your details

Forgot password? Click here to reset