A Hybrid Partitioning Strategy for Backward Reachability of Neural Feedback Loops

by   Nicholas Rober, et al.
Ford Motor Company

As neural networks become more integrated into the systems that we depend on for transportation, medicine, and security, it becomes increasingly important that we develop methods to analyze their behavior to ensure that they are safe to use within these contexts. The methods used in this paper seek to certify safety for closed-loop systems with neural network controllers, i.e., neural feedback loops, using backward reachability analysis. Namely, we calculate backprojection (BP) set over-approximations (BPOAs), i.e., sets of states that lead to a given target set that bounds dangerous regions of the state space. The system's safety can then be certified by checking its current state against the BPOAs. While over-approximating BPs is significantly faster than calculating exact BP sets, solving the relaxed problem leads to conservativeness. To combat conservativeness, partitioning strategies can be used to split the problem into a set of sub-problems, each less conservative than the unpartitioned problem. We introduce a hybrid partitioning method that uses both target set partitioning (TSP) and backreachable set partitioning (BRSP) to overcome a lower bound on estimation error that is present when using BRSP. Numerical results demonstrate a near order-of-magnitude reduction in estimation error compared to BRSP or TSP given the same computation time.


Backward Reachability Analysis of Neural Feedback Loops: Techniques for Linear and Nonlinear Systems

The increasing prevalence of neural networks (NNs) in safety-critical ap...

Reachability Analysis of Neural Feedback Loops

Neural Networks (NNs) can provide major empirical performance improvemen...

Backward Reachability Analysis for Neural Feedback Loops

The increasing prevalence of neural networks (NNs) in safety-critical ap...

DRIP: Domain Refinement Iteration with Polytopes for Backward Reachability Analysis of Neural Feedback Loops

Safety certification of data-driven control techniques remains a major o...

Lex-Partitioning: A New Option for BDD Search

For the exploration of large state spaces, symbolic search using binary ...

Efficient Backward Reachability Using the Minkowski Difference of Constrained Zonotopes

Backward reachability analysis is essential to synthesizing controllers ...

Computing Forward Reachable Sets for Nonlinear Adaptive Multirotor Controllers

In multirotor systems, guaranteeing safety while considering unknown dis...

Please sign up or login with your details

Forgot password? Click here to reset