Hierarchical Motion Planning under Probabilistic Temporal Tasks and Safe-Return Constraints

02/10/2023
by   Meng Guo, et al.
0

Safety is crucial for robotic missions within an uncertain environment. Common safety requirements such as collision avoidance are only state-dependent, which can be restrictive for complex missions. In this work, we address a more general formulation as safe-return constraints, which require the existence of a return-policy to drive the system back to a set of safe states with high probability. The robot motion is modeled as a Markov Decision Process (MDP) with probabilistic labels, which can be highly non-ergodic. The robotic task is specified as Linear Temporal Logic (LTL) formulas over these labels, such as surveillance and transportation. We first provide theoretical guarantees on the re-formulation of such safe-return constraints, and a baseline solution based on computing two complete product automata. Furthermore, to tackle the computational complexity, we propose a hierarchical planning algorithm that combines the feature-based symbolic and temporal abstraction with constrained optimization. It synthesizes simultaneously two dependent motion policies: the outbound policy minimizes the overall cost of satisfying the task with a high probability, while the return policy ensures the safe-return constraints. The problem formulation is versatile regarding the robot model, task specifications and safety constraints. The proposed hierarchical algorithm is more efficient and can solve much larger problems than the baseline solution, with only a slight loss of optimality. Numerical validations include simulations and hardware experiments of a search-and-rescue mission and a planetary exploration mission over various system sizes.

READ FULL TEXT

page 1

page 11

page 13

page 14

page 15

research
02/10/2023

Online Planning of Uncertain MDPs under Temporal Tasks and Safe-Return Constraints

This paper addresses the online motion planning problem of mobile robots...
research
09/20/2019

Reconnaissance and Planning algorithm for constrained MDP

Practical reinforcement learning problems are often formulated as constr...
research
11/10/2022

Safety-Constrained Policy Transfer with Successor Features

In this work, we focus on the problem of safe policy transfer in reinfor...
research
05/27/2021

GoSafe: Globally Optimal Safe Robot Learning

When learning policies for robotic systems from data, safety is a major ...
research
04/04/2023

Safe Explicable Robot Planning

Human expectations stem from their knowledge of the others and the world...
research
02/06/2020

Scalable and Probabilistically Complete Planning for Robotic Spatial Extrusion

There is increasing demand for automated systems that can fabricate 3D s...
research
09/24/2020

Robust Finite-State Controllers for Uncertain POMDPs

Uncertain partially observable Markov decision processes (uPOMDPs) allow...

Please sign up or login with your details

Forgot password? Click here to reset