Stochastic Variational Smoothed Model Checking

05/11/2022
by   Luca Bortolussi, et al.
0

Model-checking for parametric stochastic models can be expressed as checking the satisfaction probability of a certain property as a function of the parameters of the model. Smoothed model checking (smMC) leverages Gaussian Processes (GP) to infer the satisfaction function over the entire parameter space from a limited set of observations obtained via simulation. This approach provides accurate reconstructions with statistically sound quantification of the uncertainty. However, it inherits the scalability issues of GP. In this paper, we exploit recent advances in probabilistic machine learning to push this limitation forward, making Bayesian inference of smMC scalable to larger datasets, enabling its application to larger models in terms of the dimension of the parameter set. We propose Stochastic Variational Smoothed Model Checking (SV-smMC), a solution that exploits stochastic variational inference (SVI) to approximate the posterior distribution of the smMC problem. The strength and flexibility of SVI make SV-smMC applicable to two alternative probabilistic models: Gaussian Processes (GP) and Bayesian Neural Networks (BNN). Moreover, SVI makes inference easily parallelizable and it enables GPU acceleration. In this paper, we compare the performances of smMC against those of SV-smMC by looking at the scalability, the computational efficiency and at the accuracy of the reconstructed satisfaction function.

READ FULL TEXT

page 15

page 21

research
04/20/2021

Active and sparse methods in smoothed model checking

Smoothed model checking based on Gaussian process classification provide...
research
02/28/2017

Bayesian Verification under Model Uncertainty

Machine learning enables systems to build and update domain models based...
research
10/14/2016

Random Feature Expansions for Deep Gaussian Processes

The composition of multiple Gaussian Processes as a Deep Gaussian Proces...
research
10/31/2019

Continual Multi-task Gaussian Processes

We address the problem of continual learning in multi-task Gaussian proc...
research
01/24/2022

Learning Model Checking and the Kernel Trick for Signal Temporal Logic on Stochastic Processes

We introduce a similarity function on formulae of signal temporal logic ...
research
09/22/2022

Simulation-based inference of Bayesian hierarchical models while checking for model misspecification

This paper presents recent methodological advances to perform simulation...
research
07/03/2020

Stochastic Variational Bayesian Inference for a Nonlinear Forward Model

Variational Bayes (VB) has been used to facilitate the calculation of th...

Please sign up or login with your details

Forgot password? Click here to reset