DeepAI AI Chat
Log In Sign Up

Compositional Verification for Autonomous Systems with Deep Learning Components

by   Corina S. Pasareanu, et al.
Carnegie Mellon University

As autonomy becomes prevalent in many applications, ranging from recommendation systems to fully autonomous vehicles, there is an increased need to provide safety guarantees for such systems. The problem is difficult, as these are large, complex systems which operate in uncertain environments, requiring data-driven machine-learning components. However, learning techniques such as Deep Neural Networks, widely used today, are inherently unpredictable and lack the theoretical foundations to provide strong assurance guarantees. We present a compositional approach for the scalable, formal verification of autonomous systems that contain Deep Neural Network components. The approach uses assume-guarantee reasoning whereby contracts, encoding the input-output behavior of individual components, allow the designer to model and incorporate the behavior of the learning-enabled components working side-by-side with the other components. We illustrate the approach on an example taken from the autonomous vehicles domain.


page 1

page 2

page 3

page 4


Practical Solutions for Machine Learning Safety in Autonomous Vehicles

Autonomous vehicles rely on machine learning to solve challenging tasks ...

Proceedings First Workshop on Formal Verification of Autonomous Vehicles

These are the proceedings of the workshop on Formal Verification of Auto...

Towards Mechatronics Approach of System Design, Verification and Validation for Autonomous Vehicles

Modern-day autonomous vehicles are increasingly becoming complex multidi...

Towards Compositional Verification for Modular Robotic Systems

Software engineering of modular robotic systems is a challenging task, h...

Automated Verification of Neural Networks: Advances, Challenges and Perspectives

Neural networks are one of the most investigated and widely used techniq...

Towards Safety Verification of Direct Perception Neural Networks

We study the problem of safety verification of direct perception neural ...

AlgebraicSystems: Compositional Verification for Autonomous System Design

Autonomous systems require the management of several model views to assu...