DeepAI AI Chat
Log In Sign Up

ProvMark: A Provenance Expressiveness Benchmarking System

09/24/2019
by   Sheung Chi Chan, et al.
0

System level provenance is of widespread interest for applications such as security enforcement and information protection. However, testing the correctness or completeness of provenance capture tools is challenging and currently done manually. In some cases there is not even a clear consensus about what behavior is correct. We present an automated tool, ProvMark, that uses an existing provenance system as a black box and reliably identifies the provenance graph structure recorded for a given activity, by a reduction to subgraph isomorphism problems handled by an external solver. ProvMark is a beginning step in the much needed area of testing and comparing the expressiveness of provenance systems. We demonstrate ProvMark's usefuless in comparing three capture systems with different architectures and distinct design philosophies.

READ FULL TEXT
03/29/2016

COCO: A Platform for Comparing Continuous Optimizers in a Black-Box Setting

COCO is a platform for Comparing Continuous Optimizers in a black-box se...
09/17/2021

Benchmarking Feature-based Algorithm Selection Systems for Black-box Numerical Optimization

Feature-based algorithm selection aims to automatically find the best on...
08/18/2021

Empirical Comparison of Black-box Test Case Generation Tools for RESTful APIs

In literature, we can find research tools to automatically generate test...
01/22/2020

CDST: A Toolkit for Testing Cockpit Display Systems of Avionics

Avionics are highly critical systems that require extensive testing gove...
12/27/2018

Fine-grained Code Coverage Measurement in Automated Black-box Android Testing

Today, there are millions of third-party Android applications. Some of t...
05/25/2021

Payment Does Not Imply Consensus (For Distributed Payment Systems)

Decentralized payment systems such as Bitcoin have become massively popu...