Applying Distributed Ledgers to Manage Workflow Provenance

04/15/2018
by   Jay Jay Billings, et al.
0

Sharing provenance across workflow management systems automatically is not currently possible, but the value of such a capability is high since it could greatly reduce the amount of duplicated workflows, accelerate the discovery of new knowledge, and verify the integrity of past and present analyses. Although numerous technological challenges exist to efficiently share provenance information across workflow management systems, permissioned distributed ledgers could surmount many of them. The primary benefit of permissioned distributed ledgers over other technologies is that their distribution is over a peer-to-peer network that encodes transactions across the network into an immutable hash list and achieves consensus on the validity of the new data through a common consensus mechanism. This work discusses provenance and distributed ledgers on their own and then presents an argument that distributed ledgers naturally satisfy many of the requirements of workflow provenance, that provenance information can exist in the ledger in multiple ways, and that a number of novel research areas exist based on this strategy.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/23/2020

A Bespoke Workflow Management System for Data-Driven Urgent HPC

In this paper we present a workflow management system which permits the ...
research
06/10/2020

Adapting Workflow Management Systems to BFT Blockchains – The YAWL Example

Blockchain technology provides an auditable and tamper-proof distributed...
research
05/29/2019

Workflow Management on BFT Blockchains

Blockchain technology has been proposed as a new infrastructure technolo...
research
11/26/2021

Towards a Secure and Reliable IT-Ecosystem in Seaports

Digitalization in seaports dovetails the IT infrastructure of various ac...
research
01/18/2023

A Workflow Model for Holistic Data Management and Semantic Interoperability in Quantitative Archival Research

Archival research is a complicated task that involves several diverse ac...
research
01/11/2018

The archive solution for distributed workflow management agents of the CMS experiment at LHC

The CMS experiment at the CERN LHC developed the Workflow Management Arc...

Please sign up or login with your details

Forgot password? Click here to reset