DiffLoop: Tuning PID controllers by differentiating through the feedback loop

06/19/2021
by   Athindran Ramesh Kumar, et al.
0

Since most industrial control applications use PID controllers, PID tuning and anti-windup measures are significant problems. This paper investigates tuning the feedback gains of a PID controller via back-calculation and automatic differentiation tools. In particular, we episodically use a cost function to generate gradients and perform gradient descent to improve controller performance. We provide a theoretical framework for analyzing this non-convex optimization and establish a relationship between back-calculation and disturbance feedback policies. We include numerical experiments on linear systems with actuator saturation to show the efficacy of this approach.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/24/2018

Convex Optimization of Nonlinear State Feedback Controllers for Discrete-time Polynomial Systems via Occupation Measures

In this paper, we design nonlinear state feedback controllers for discre...
research
05/10/2020

Reinforcement Learning based Design of Linear Fixed Structure Controllers

Reinforcement learning has been successfully applied to the problem of t...
research
11/06/2021

Feedback Control of Millimeter Scale Pivot Walkers Using Magnetic Actuation

An external magnetic field can be used to remotely control small-scaled ...
research
05/10/2020

Optimal PID and Antiwindup Control Design as a Reinforcement Learning Problem

Deep reinforcement learning (DRL) has seen several successful applicatio...
research
06/06/2021

Distributed Task Allocation in Homogeneous Swarms Using Language Measure Theory

In this paper, we present algorithms for synthesizing controllers to dis...
research
11/08/2021

Gradient-Descent for Randomized Controllers under Partial Observability

Randomization is a powerful technique to create robust controllers, in p...
research
03/08/2017

Model-Based Policy Search for Automatic Tuning of Multivariate PID Controllers

PID control architectures are widely used in industrial applications. De...

Please sign up or login with your details

Forgot password? Click here to reset