NExG: Provable and Guided State Space Exploration of Neural Network Control Systems using Sensitivity Approximation

07/08/2022
by   Manish Goyal, et al.
0

We propose a new technique for performing state space exploration of closed loop control systems with neural network feedback controllers. Our approach involves approximating the sensitivity of the trajectories of the closed loop dynamics. Using such an approximator and the system simulator, we present a guided state space exploration method that can generate trajectories visiting the neighborhood of a target state at a specified time. We present a theoretical framework which establishes that our method will produce a sequence of trajectories that will reach a suitable neighborhood of the target state. We provide thorough evaluation of our approach on various systems with neural network feedback controllers of different configurations. We outperform earlier state space exploration techniques and achieve significant improvement in both the quality (explainability) and performance (convergence rate). Finally, we adopt our algorithm for the falsification of a class of temporal logic specification, assess its performance against a state-of-the-art falsification tool, and show its potential in supplementing existing falsification algorithms.

READ FULL TEXT
research
09/26/2018

Adding Neural Network Controllers to Behavior Trees without Destroying Performance Guarantees

In this paper, we show how controllers created using data driven designs...
research
09/25/2018

Sampling-based Polytopic Trees for Approximate Optimal Control of Piecewise Affine Systems

Piecewise affine (PWA) systems are widely used to model highly nonlinear...
research
09/29/2021

Lyapunov-stable neural-network control

Deep learning has had a far reaching impact in robotics. Specifically, d...
research
05/04/2020

Localized active learning of Gaussian process state space models

The performance of learning-based control techniques crucially depends o...
research
06/22/2021

Failing with Grace: Learning Neural Network Controllers that are Boundedly Unsafe

In this work, we consider the problem of learning a feed-forward neural ...
research
05/01/2018

A Feedback Neural Network for Small Target Motion Detection in Cluttered Backgrounds

Small target motion detection is critical for insects to search for and ...
research
10/04/2022

Data-Efficient Characterization of the Global Dynamics of Robot Controllers with Confidence Guarantees

This paper proposes an integration of surrogate modeling and topology to...

Please sign up or login with your details

Forgot password? Click here to reset