Model-free tracking control of complex dynamical trajectories with machine learning

09/20/2023
by   Zheng-Meng Zhai, et al.
0

Nonlinear tracking control enabling a dynamical system to track a desired trajectory is fundamental to robotics, serving a wide range of civil and defense applications. In control engineering, designing tracking control requires complete knowledge of the system model and equations. We develop a model-free, machine-learning framework to control a two-arm robotic manipulator using only partially observed states, where the controller is realized by reservoir computing. Stochastic input is exploited for training, which consists of the observed partial state vector as the first and its immediate future as the second component so that the neural machine regards the latter as the future state of the former. In the testing (deployment) phase, the immediate-future component is replaced by the desired observational vector from the reference trajectory. We demonstrate the effectiveness of the control framework using a variety of periodic and chaotic signals, and establish its robustness against measurement noise, disturbances, and uncertainties.

READ FULL TEXT

page 14

page 15

page 16

research
07/07/2023

Controlling Chaotic Maps using Next-Generation Reservoir Computing

In this work, we combine nonlinear system control techniques with next-g...
research
10/05/2020

Model-Free Control of Dynamical Systems with Deep Reservoir Computing

We propose and demonstrate a nonlinear control method that can be applie...
research
04/01/2021

Trajectory Tracking of Underactuated Sea Vessels With Uncertain Dynamics: An Integral Reinforcement Learning Approach

Underactuated systems like sea vessels have degrees of motion that are i...
research
03/13/2019

Trajectory Optimization for Unknown Constrained Systems using Reinforcement Learning

In this paper, we propose a reinforcement learning-based algorithm for t...
research
09/16/2019

Adaptive Dynamic Programming for Model-free Tracking of Trajectories with Time-varying Parameters

In order to autonomously learn to control unknown systems optimally w.r....
research
05/30/2021

On the Controllers Based on Time Delay Estimation for Robotic Manipulators

Assurance of asymptotic trajectory tracking in robotic manipulators with...
research
03/09/2021

Risk-Averse RRT* Planning with Nonlinear Steering and Tracking Controllers for Nonlinear Robotic Systems Under Uncertainty

We propose a two-phase risk-averse architecture for controlling stochast...

Please sign up or login with your details

Forgot password? Click here to reset