Data-Efficient Characterization of the Global Dynamics of Robot Controllers with Confidence Guarantees

10/04/2022
by   Ewerton R. Vieira, et al.
0

This paper proposes an integration of surrogate modeling and topology to significantly reduce the amount of data required to describe the underlying global dynamics of robot controllers, including closed-box ones. A Gaussian Process (GP), trained with randomized short trajectories over the state-space, acts as a surrogate model for the underlying dynamical system. Then, a combinatorial representation is built and used to describe the dynamics in the form of a directed acyclic graph, known as Morse graph. The Morse graph is able to describe the system's attractors and their corresponding regions of attraction (). Furthermore, a pointwise confidence level of the global dynamics estimation over the entire state space is provided. In contrast to alternatives, the framework does not require estimation of Lyapunov functions, alleviating the need for high prediction accuracy of the GP. The framework is suitable for data-driven controllers that do not expose an analytical model as long as Lipschitz-continuity is satisfied. The method is compared against established analytical and recent machine learning alternatives for estimating s, outperforming them in data efficiency without sacrificing accuracy. Link to code: https://go.rutgers.edu/49hy35en

READ FULL TEXT

page 1

page 3

page 6

research
02/17/2022

Morse Graphs: Topological Tools for Analyzing the Global Dynamics of Robot Controllers

Understanding the global dynamics of a robot controller, such as identif...
research
09/26/2018

Adding Neural Network Controllers to Behavior Trees without Destroying Performance Guarantees

In this paper, we show how controllers created using data driven designs...
research
01/21/2023

Towards Flexibility and Interpretability of Gaussian Process State-Space Model

Gaussian process state-space model (GPSSM) has attracted much attention ...
research
08/03/2023

End-to-End Reinforcement Learning of Koopman Models for Economic Nonlinear MPC

(Economic) nonlinear model predictive control ((e)NMPC) requires dynamic...
research
07/26/2018

A Data-Efficient Approach to Precise and Controlled Pushing

Decades of research in control theory have shown that simple controllers...
research
07/08/2022

NExG: Provable and Guided State Space Exploration of Neural Network Control Systems using Sensitivity Approximation

We propose a new technique for performing state space exploration of clo...
research
03/13/2019

A Framework for On-line Learning of Underwater Vehicles Dynamic Models

Learning the dynamics of robots from data can help achieve more accurate...

Please sign up or login with your details

Forgot password? Click here to reset