ProvMark: A Provenance Expressiveness Benchmarking System

09/24/2019
by   Sheung Chi Chan, et al.
0

System level provenance is of widespread interest for applications such as security enforcement and information protection. However, testing the correctness or completeness of provenance capture tools is challenging and currently done manually. In some cases there is not even a clear consensus about what behavior is correct. We present an automated tool, ProvMark, that uses an existing provenance system as a black box and reliably identifies the provenance graph structure recorded for a given activity, by a reduction to subgraph isomorphism problems handled by an external solver. ProvMark is a beginning step in the much needed area of testing and comparing the expressiveness of provenance systems. We demonstrate ProvMark's usefuless in comparing three capture systems with different architectures and distinct design philosophies.

READ FULL TEXT
research
03/29/2016

COCO: A Platform for Comparing Continuous Optimizers in a Black-Box Setting

COCO is a platform for Comparing Continuous Optimizers in a black-box se...
research
05/23/2016

BMOBench: Black-Box Multi-Objective Optimization Benchmarking Platform

This document briefly describes the Black-Box Multi-Objective Optimizati...
research
04/15/2023

Accessibility Metatesting: Comparing Nine Testing Tools

Automated web accessibility testing tools have been found complementary....
research
01/22/2020

CDST: A Toolkit for Testing Cockpit Display Systems of Avionics

Avionics are highly critical systems that require extensive testing gove...
research
12/27/2018

Fine-grained Code Coverage Measurement in Automated Black-box Android Testing

Today, there are millions of third-party Android applications. Some of t...
research
05/25/2021

Payment Does Not Imply Consensus (For Distributed Payment Systems)

Decentralized payment systems such as Bitcoin have become massively popu...
research
08/17/2023

Hyperfuzzing: black-box security hypertesting with a grey-box fuzzer

Information leakage is a class of error that can lead to severe conseque...

Please sign up or login with your details

Forgot password? Click here to reset