DeepAI AI Chat
Log In Sign Up

Path Planning Using Wassertein Distributionally Robust Deep Q-learning

by   Cem Alpturk, et al.

We investigate the problem of risk averse robot path planning using the deep reinforcement learning and distributionally robust optimization perspectives. Our problem formulation involves modelling the robot as a stochastic linear dynamical system, assuming that a collection of process noise samples is available. We cast the risk averse motion planning problem as a Markov decision process and propose a continuous reward function design that explicitly takes into account the risk of collision with obstacles while encouraging the robot's motion towards the goal. We learn the risk-averse robot control actions through Lipschitz approximated Wasserstein distributionally robust deep Q-learning to hedge against the noise uncertainty. The learned control actions result in a safe and risk averse trajectory from the source to the goal, avoiding all the obstacles. Various supporting numerical simulations are presented to demonstrate our proposed approach.


Modelling and Path Planning of Snake Robot in cluttered environment

Studying snake robot locomotion in a cluttered environment has been a co...

Explicit Motion Risk Representation

This paper presents a formal definition and explicit representation of r...

Decentralized Motion Planning for Multi-Robot Navigation using Deep Reinforcement Learning

This work presents a decentralized motion planning framework for address...

Combining Safe Interval Path Planning and Constrained Path Following Control: Preliminary Results

We study the navigation problem for a robot moving amidst static and dyn...

Safe Optimal Control under Parametric Uncertainties

We address the issue of safe optimal path planning under parametric unce...

Path Planning and Controlled Crash Landing of a Quadcopter in case of a Rotor Failure

This paper presents a framework for controlled emergency landing of a qu...

Deep R-Learning for Continual Area Sweeping

Coverage path planning is a well-studied problem in robotics in which a ...