Learning-based Near-optimal Motion Planning for Intelligent Vehicles with Uncertain Dynamics

by   Yang Lu, et al.
Shandong University
National University of Defense Technology

Motion planning has been an important research topic in achieving safe and flexible maneuvers for intelligent vehicles. However, it remains challenging to realize efficient and optimal planning in the presence of uncertain model dynamics. In this paper, a sparse kernel-based reinforcement learning (RL) algorithm with Gaussian Process (GP) Regression (called GP-SKRL) is proposed to achieve online adaption and near-optimal motion planning performance. In this algorithm, we design an efficient sparse GP regression method to learn the uncertain dynamics. Based on the updated model, a sparse kernel-based policy iteration algorithm with an exponential barrier function is designed to learn the near-optimal planning policies with the capability to avoid dynamic obstacles. Thereby, batch-mode GP-SKRL with online adaption capability can estimate the changing system dynamics. The converged RL policies are then deployed on vehicles efficiently under a safety-aware module. As a result, the produced driving actions are safe and less conservative, and the planning performance has been noticeably improved. Extensive simulation results show that GP-SKRL outperforms several advanced motion planning methods in terms of average cumulative cost, trajectory length, and task completion time. In particular, experiments on a Hongqi E-HS3 vehicle demonstrate that superior GP-SKRL provides a practical planning solution.


page 1

page 8


Adaptive Gaussian Process based Stochastic Trajectory Optimization for Motion Planning

We propose a new formulation of optimal motion planning (OMP) algorithm ...

Fusion of Heterogeneous Friction Estimates for Traction Adaptive Motion Planning and Control

Traction adaptive motion planning and control has potential to improve a...

Vehicle Dynamics Modeling for Autonomous Racing Using Gaussian Processes

Autonomous racing is increasingly becoming a proving ground for autonomo...

Safe learning-based optimal motion planning for automated driving

This paper presents preliminary work on learning the search heuristic fo...

Mixed Strategies for Robust Optimization of Unknown Objectives

We consider robust optimization problems, where the goal is to optimize ...

Safe Motion Planning against Multimodal Distributions based on a Scenario Approach

We present the design of a motion planning algorithm that ensures safety...

Online Information-Aware Motion Planning with Inertial Parameter Learning for Robotic Free-Flyers

Space free-flyers like the Astrobee robots currently operating aboard th...

Please sign up or login with your details

Forgot password? Click here to reset