DeepAI AI Chat
Log In Sign Up

ProvMark: A Provenance Expressiveness Benchmarking System

by   Sheung Chi Chan, et al.

System level provenance is of widespread interest for applications such as security enforcement and information protection. However, testing the correctness or completeness of provenance capture tools is challenging and currently done manually. In some cases there is not even a clear consensus about what behavior is correct. We present an automated tool, ProvMark, that uses an existing provenance system as a black box and reliably identifies the provenance graph structure recorded for a given activity, by a reduction to subgraph isomorphism problems handled by an external solver. ProvMark is a beginning step in the much needed area of testing and comparing the expressiveness of provenance systems. We demonstrate ProvMark's usefuless in comparing three capture systems with different architectures and distinct design philosophies.


COCO: A Platform for Comparing Continuous Optimizers in a Black-Box Setting

COCO is a platform for Comparing Continuous Optimizers in a black-box se...

Benchmarking Feature-based Algorithm Selection Systems for Black-box Numerical Optimization

Feature-based algorithm selection aims to automatically find the best on...

Empirical Comparison of Black-box Test Case Generation Tools for RESTful APIs

In literature, we can find research tools to automatically generate test...

CDST: A Toolkit for Testing Cockpit Display Systems of Avionics

Avionics are highly critical systems that require extensive testing gove...

Fine-grained Code Coverage Measurement in Automated Black-box Android Testing

Today, there are millions of third-party Android applications. Some of t...

Payment Does Not Imply Consensus (For Distributed Payment Systems)

Decentralized payment systems such as Bitcoin have become massively popu...