Learning over All Stabilizing Nonlinear Controllers for a Partially-Observed Linear System

12/08/2021
by   Ruigang Wang, et al.
0

We propose a parameterization of nonlinear output feedback controllers for linear dynamical systems based on a recently developed class of neural network called the recurrent equilibrium network (REN), and a nonlinear version of the Youla parameterization. Our approach guarantees the closed-loop stability of partially observable linear dynamical systems without requiring any constraints to be satisfied. This significantly simplifies model fitting as any unconstrained optimization procedure can be applied whilst still maintaining stability. We demonstrate our method on reinforcement learning tasks with both exact and approximate gradient methods. Simulation studies show that our method is significantly more scalable and significantly outperforms other approaches in the same problem setting.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/12/2023

Learning Over All Contracting and Lipschitz Closed-Loops for Partially-Observed Nonlinear Systems

This paper presents a policy parameterization for learning-based control...
research
12/02/2021

Youla-REN: Learning Nonlinear Feedback Policies with Robust Stability Guarantees

This paper presents a parameterization of nonlinear controllers for unce...
research
01/06/2021

Constrained Block Nonlinear Neural Dynamical Models

Neural network modules conditioned by known priors can be effectively tr...
research
09/08/2021

Recurrent Neural Network Controllers Synthesis with Stability Guarantees for Partially Observed Systems

Neural network controllers have become popular in control tasks thanks t...
research
04/07/2023

A modular framework for stabilizing deep reinforcement learning control

We propose a framework for the design of feedback controllers that combi...
research
02/11/2021

Sufficiently Accurate Model Learning for Planning

Data driven models of dynamical systems help planners and controllers to...
research
03/31/2022

Synthesis of Stabilizing Recurrent Equilibrium Network Controllers

We propose a parameterization of a nonlinear dynamic controller based on...

Please sign up or login with your details

Forgot password? Click here to reset