DeepAI AI Chat
Log In Sign Up

Path Planning Using Wassertein Distributionally Robust Deep Q-learning

11/04/2022
by   Cem Alpturk, et al.
LUNDS TEKNISKA HÖGSKOLA
0

We investigate the problem of risk averse robot path planning using the deep reinforcement learning and distributionally robust optimization perspectives. Our problem formulation involves modelling the robot as a stochastic linear dynamical system, assuming that a collection of process noise samples is available. We cast the risk averse motion planning problem as a Markov decision process and propose a continuous reward function design that explicitly takes into account the risk of collision with obstacles while encouraging the robot's motion towards the goal. We learn the risk-averse robot control actions through Lipschitz approximated Wasserstein distributionally robust deep Q-learning to hedge against the noise uncertainty. The learned control actions result in a safe and risk averse trajectory from the source to the goal, avoiding all the obstacles. Various supporting numerical simulations are presented to demonstrate our proposed approach.

READ FULL TEXT
10/07/2017

Modelling and Path Planning of Snake Robot in cluttered environment

Studying snake robot locomotion in a cluttered environment has been a co...
04/16/2019

Explicit Motion Risk Representation

This paper presents a formal definition and explicit representation of r...
11/11/2020

Decentralized Motion Planning for Multi-Robot Navigation using Deep Reinforcement Learning

This work presents a decentralized motion planning framework for address...
06/17/2019

Combining Safe Interval Path Planning and Constrained Path Following Control: Preliminary Results

We study the navigation problem for a robot moving amidst static and dyn...
02/25/2020

Safe Optimal Control under Parametric Uncertainties

We address the issue of safe optimal path planning under parametric unce...
09/25/2018

Path Planning and Controlled Crash Landing of a Quadcopter in case of a Rotor Failure

This paper presents a framework for controlled emergency landing of a qu...
05/31/2020

Deep R-Learning for Continual Area Sweeping

Coverage path planning is a well-studied problem in robotics in which a ...