Zero-Shot Policy Transferability for the Control of a Scale Autonomous Vehicle

09/18/2023
by   Harry Zhang, et al.
0

We report on a study that employs an in-house developed simulation infrastructure to accomplish zero shot policy transferability for a control policy associated with a scale autonomous vehicle. We focus on implementing policies that require no real world data to be trained (Zero-Shot Transfer), and are developed in-house as opposed to being validated by previous works. We do this by implementing a Neural Network (NN) controller that is trained only on a family of circular reference trajectories. The sensors used are RTK-GPS and IMU, the latter for providing heading. The NN controller is trained using either a human driver (via human in the loop simulation), or a Model Predictive Control (MPC) strategy. We demonstrate these two approaches in conjunction with two operation scenarios: the vehicle follows a waypoint-defined trajectory at constant speed; and the vehicle follows a speed profile that changes along the vehicle's waypoint-defined trajectory. The primary contribution of this work is the demonstration of Zero-Shot Transfer in conjunction with a novel feed-forward NN controller trained using a general purpose, in-house developed simulation platform.

READ FULL TEXT
research
09/21/2021

Implementation of a self-developed model predictive control scheme for vehicle parking maneuvers

In this paper a self-developed controller algorithm is presented with th...
research
07/05/2022

Randomized-to-Canonical Model Predictive Control for Real-world Visual Robotic Manipulation

Many works have recently explored Sim-to-real transferable visual model ...
research
04/18/2023

Using simulation to design an MPC policy for field navigation using GPS sensing

Modeling a robust control system with a precise GPS-based state estimati...
research
09/28/2022

Zero-Shot Retargeting of Learned Quadruped Locomotion Policies Using Hybrid Kinodynamic Model Predictive Control

Reinforcement Learning (RL) has witnessed great strides for quadruped lo...
research
03/21/2022

Quad2Plane: An Intermediate Training Procedure for Online Exploration in Aerial Robotics via Receding Horizon Control

Data driven robotics relies upon accurate real-world representations to ...
research
12/14/2018

Simulation to scaled city: zero-shot policy transfer for traffic control via autonomous vehicles

Using deep reinforcement learning, we train control policies for autonom...
research
07/31/2023

Discovering Adaptable Symbolic Algorithms from Scratch

Autonomous robots deployed in the real world will need control policies ...

Please sign up or login with your details

Forgot password? Click here to reset