Analysis of Model-Free Reinforcement Learning Control Schemes on self-balancing Wheeled Extendible System

11/16/2021
by   Kanishk, et al.
0

Traditional linear control strategies have been extensively researched and utilized in many robotic and industrial applications and yet they don't respond to the total dynamics of the systems. To avoid tedious calculations for nonlinear control schemes like H infinity control and Predictive Control, the application of Reinforcement Learning can provide alternative solutions. This article presents the implementation of RL control with Deep Deterministic Policy Gradient and Proximal Policy Optimization on a mobile self-balancing Extendible Wheeled Inverted Pendulum (E-WIP) system. Such RL models make the task of finding a satisfactory control scheme easier and respond to the dynamics effectively while self-tuning the parameters to provide better control. In this article, two RL-based controllers are pitted against an MPC controller to evaluate the performance on the basis of state variables of the EWIP system while following a specific desired trajectory.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/31/2022

Steady-State Error Compensation in Reference Tracking and Disturbance Rejection Problems for Reinforcement Learning-Based Control

Reinforcement learning (RL) is a promising, upcoming topic in automatic ...
research
11/22/2017

Depth Control of Model-Free AUVs via Reinforcement Learning

In this paper, we consider depth control problems of an autonomous under...
research
09/26/2022

Training Efficient Controllers via Analytic Policy Gradient

Control design for robotic systems is complex and often requires solving...
research
04/06/2021

Approximate Robust NMPC using Reinforcement Learning

We present a Reinforcement Learning-based Robust Nonlinear Model Predict...
research
12/29/2020

Reinforcement Learning for Control of Valves

This paper compares reinforcement learning (RL) with PID (proportional-i...
research
04/01/2021

Optimization Algorithm for Feedback and Feedforward Policies towards Robot Control Robust to Sensing Failures

Model-free or learning-based control, in particular, reinforcement learn...
research
11/22/2020

Model Predictive Control for Micro Aerial Vehicles: A Survey

This paper presents a review of the design and application of model pred...

Please sign up or login with your details

Forgot password? Click here to reset