Suboptimal Controller Synthesis for Cart-Poles and Quadrotors via Sums-of-Squares

04/25/2023
by   Lujie Yang, et al.
0

Sums-of-squares (SOS) optimization is a promising tool to synthesize certifiable controllers, but most examples to date have been limited to relatively simple systems. Here we demonstrate that SOS can synthesize controllers with bounded suboptimal performance for various underactuated robotic systems by finding good approximations of the value function. We summarize a unified SOS framework to synthesize both under- and over- approximations of the value function for continuous-time, control-affine systems, use these approximations to generate suboptimal controllers, and perform regional analysis on the closed-loop system driven by these controllers. We then extend the formulation to handle hybrid systems with contacts. We demonstrate that our method can generate tight under- and over- approximations of the value function with low-degree polynomials, which are used to provide stabilizing controllers for continuous-time systems including the inverted pendulum, the cart-pole, and the 3D quadrotor as well as a hybrid system, the planar pusher. To the best of our knowledge, this is the first time that a SOS-based time-invariant controller can swing up and stabilize a cart-pole, and push the planar slider to the desired pose.

READ FULL TEXT

page 1

page 4

research
03/20/2018

Distributed Model Predictive Control for Linear Systems with Adaptive Terminal Sets

In this paper, we propose a distributed model predictive control (DMPC) ...
research
05/30/2023

Improving the performance of Learned Controllers in Behavior Trees using Value Function Estimates at Switching Boundaries

Behavior trees represent a modular way to create an overall controller f...
research
06/08/2018

Continuous-time Value Function Approximation in Reproducing Kernel Hilbert Spaces

Motivated by the success of reinforcement learning (RL) for discrete-tim...
research
11/11/2021

Model-Based Reinforcement Learning for Stochastic Hybrid Systems

Optimal control of general nonlinear systems is a central challenge in a...
research
12/06/2018

Formal Synthesis of Analytic Controllers for Sampled-Data Systems via Genetic Programming

This paper presents an automatic formal controller synthesis method for ...
research
06/20/2021

Optimal Strategies for Decision Theoretic Online Learning

We extend the drifting games analysis to continuous time and show that t...
research
09/20/2019

Impedance Control of a Transfemoral Prosthesis using Continuously Varying Ankle Impedances and Multiple Equilibria

Impedance controllers are popularly used in the field of lower limb pros...

Please sign up or login with your details

Forgot password? Click here to reset