A Minimum Discounted Reward Hamilton-Jacobi Formulation for Computing Reachable Sets

by   Anayo K. Akametalu, et al.

We propose a novel formulation for approximating reachable sets through a minimum discounted reward optimal control problem. The formulation yields a continuous solution that can be obtained by solving a Hamilton-Jacobi equation. Furthermore, the numerical approximation to this solution can be obtained as the unique fixed-point to a contraction mapping. This allows for more efficient solution methods that could not be applied under traditional formulations for solving reachable sets. In addition, this formulation provides a link between reinforcement learning and learning reachable sets for systems with unknown dynamics, allowing algorithms from the former to be applied to the latter. We use two benchmark examples, double integrator, and pursuit-evasion games, to show the correctness of the formulation as well as its strengths in comparison to previous work.


Approximate Inference and Stochastic Optimal Control

We propose a novel reformulation of the stochastic optimal control probl...

Discounted Reinforcement Learning is Not an Optimization Problem

Discounted reinforcement learning is fundamentally incompatible with fun...

Bernstein approximation of optimal control problems

Bernstein polynomial approximation to a continuous function has a slower...

Solving Stabilize-Avoid Optimal Control via Epigraph Form and Deep Reinforcement Learning

Tasks for autonomous robotic systems commonly require stabilization to a...

Safety and Liveness Guarantees through Reach-Avoid Reinforcement Learning

Reach-avoid optimal control problems, in which the system must reach cer...

An Assignment Problem Formulation for Dominance Move Indicator

Dominance move (DoM) is a binary quality indicator to compare solution s...

Sparse solutions in optimal control of PDEs with uncertain parameters: the linear case

We study sparse solutions of optimal control problems governed by PDEs w...

Please sign up or login with your details

Forgot password? Click here to reset