Multi-vehicle Conflict Resolution in Highly Constrained Spaces by Merging Optimal Control and Reinforcement Learning

11/02/2022
by   Xu Shen, et al.
0

We present a novel method to address the problem of multi-vehicle conflict resolution in highly constrained spaces. An optimal control problem is formulated to incorporate nonlinear, non-holonomic vehicle dynamics and exact collision avoidance constraints. A solution to the problem can be obtained by first learning configuration strategies with reinforcement learning (RL) in a simplified discrete environment, and then using these strategies to shape the constraint space of the original problem. Simulation results show that our method can explore efficient actions to resolve conflicts in confined space and generate dexterous maneuvers that are both collision-free and kinematically feasible.

READ FULL TEXT

page 2

page 3

page 4

page 5

page 6

research
02/03/2023

Reinforcement Learning and Distributed Model Predictive Control for Conflict Resolution in Highly Constrained Spaces

This work presents a distributed algorithm for resolving cooperative mul...
research
05/02/2023

Mixed-Integer Optimal Control via Reinforcement Learning: A Case Study on Hybrid Vehicle Energy Management

Many optimal control problems require the simultaneous output of continu...
research
10/26/2019

Convergent Policy Optimization for Safe Reinforcement Learning

We study the safe reinforcement learning problem with nonlinear function...
research
03/02/2021

Model-based Constrained Reinforcement Learning using Generalized Control Barrier Function

Model information can be used to predict future trajectories, so it has ...
research
04/20/2021

Model-predictive control and reinforcement learning in multi-energy system case studies

Model-predictive-control (MPC) offers an optimal control technique to es...
research
11/28/2018

Deep Reinforcement Learning for Time Optimal Velocity Control using Prior Knowledge

While autonomous navigation has recently gained great interest in the fi...
research
03/20/2017

Complex Number Formulation and Convex Relaxations for Aircraft Conflict Resolution

We present a novel complex number formulation along with tight convex re...

Please sign up or login with your details

Forgot password? Click here to reset