Higher-order algorithms for nonlinearly parameterized adaptive control

12/31/2019
by   Nicholas M. Boffi, et al.
0

A set of new adaptive control algorithms is presented. The algorithms are applicable to linearly parameterized systems and to nonlinearly parameterized systems satisfying a certain monotonicity requirement. A variational perspective based on the Bregman Lagrangian (Wibisono, Wilson, Jordan, 2016) is adopted to define a general framework that systematically generates higher-order in-time speed gradient algorithms. These general algorithms reduce to a recently developed method as a special case, and naturally extend to composite methods that combine perspectives from both adaptive control and system identification. A provocative connection between adaptive control algorithms for nonlinearly parameterized systems and algorithms for isotonic regression and provable neural network learning is utilized to extend these higher-order algorithms to the realm of nonlinearly parameterized systems. Modifications to all presented algorithms inspired by recent progress in distributed stochastic gradient descent algorithms are developed. Time-varying learning rate matrices based on exponential forgetting/bounded gain forgetting least squares can be stably employed in the higher-order context, and conditions for their applicability in the nonlinearly parameterized setting are provided. A consistent theme of our contribution is the exploitation of strong connections between classical nonlinear adaptive control techniques and recent progress in optimization and machine learning.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/12/2019

Accelerated Learning in the Presence of Time Varying Features with Applications to Machine Learning and Adaptive Control

Features in machine learning problems are often time varying and may be ...
research
10/15/2019

On Higher-order Moments in Adam

In this paper, we investigate the popular deep learning optimization rou...
research
04/11/2019

Connections Between Adaptive Control and Optimization in Machine Learning

This paper demonstrates many immediate connections between adaptive cont...
research
03/23/2021

A High-order Tuner for Accelerated Learning and Control

Gradient-descent based iterative algorithms pervade a variety of problem...
research
08/24/2022

Higher-order adaptive methods for exit times of Itô diffusions

We construct a higher-order adaptive method for strong approximations of...
research
08/08/2023

Real-Time Progressive Learning: Mutually Reinforcing Learning and Control with Neural-Network-Based Selective Memory

Memory, as the basis of learning, determines the storage, update and for...
research
03/20/2020

Event-Based Control for Online Training of Neural Networks

Convolutional Neural Network (CNN) has become the most used method for i...

Please sign up or login with your details

Forgot password? Click here to reset