Analysis and Design of Quadratic Neural Networks for Regression, Classification, and Lyapunov Control of Dynamical Systems

07/26/2022
by   Luis Rodrigues, et al.
0

This paper addresses the analysis and design of quadratic neural networks, which have been recently introduced in the literature, and their applications to regression, classification, system identification and control of dynamical systems. These networks offer several advantages, the most important of which are the fact that the architecture is a by-product of the design and is not determined a-priori, their training can be done by solving a convex optimization problem so that the global optimum of the weights is achieved, and the input-output mapping can be expressed analytically by a quadratic form. It also appears from several examples that these networks work extremely well using only a small fraction of the training data. The results in the paper cast regression, classification, system identification, stability and control design as convex optimization problems, which can be solved efficiently with polynomial-time algorithms to a global optimum. Several examples will show the effectiveness of quadratic neural networks in applications.

READ FULL TEXT
research
10/05/2016

Nonlinear Systems Identification Using Deep Dynamic Neural Networks

Neural networks are known to be effective function approximators. Recent...
research
05/29/2018

Review of Applications of Generalized Regression Neural Networks in Identification and Control of Dynamic Systems

This paper depicts a brief revision of Generalized Regression Neural Net...
research
12/19/2019

Learning Convex Optimization Control Policies

Many control policies used in various applications determine the input o...
research
05/04/2021

Training Quantized Neural Networks to Global Optimality via Semidefinite Programming

Neural networks (NNs) have been extremely successful across many tasks i...
research
08/26/2023

Guaranteed Stable Quadratic Models and their applications in SINDy and Operator Inference

Scientific machine learning for learning dynamical systems is a powerful...
research
06/23/2020

A Dynamical Systems Approach for Convergence of the Bayesian EM Algorithm

Out of the recent advances in systems and control (S&C)-based analysis o...
research
02/27/2018

Identification of LTV Dynamical Models with Smooth or Discontinuous Time Evolution by means of Convex Optimization

We establish a connection between trend filtering and system identificat...

Please sign up or login with your details

Forgot password? Click here to reset