Rucio - Scientific Data Management

02/26/2019
by   Martin Barisits, et al.
0

Rucio is an open source software framework that provides scientific collaborations with the functionality to organize, manage, and access their volumes of data. The data can be distributed across heterogeneous data centers at widely distributed locations. Rucio has been originally developed to meet the requirements of the high-energy physics experiment ATLAS, and is continuously extended to support the LHC experiments and other diverse scientific communities. In this article we detail the fundamental concepts of Rucio, describe the architecture along with implementation details, and give operational experience from production usage.

READ FULL TEXT

page 10

page 13

page 15

research
03/14/2022

Deploying in-network caches in support of distributed scientific data sharing

The importance of intelligent data placement, management, and analysis h...
research
08/02/2022

Smart caching in a Data Lake for High Energy Physics analysis

The continuous growth of data production in almost all scientific areas ...
research
04/07/2020

DataFed: Towards Reproducible Research via Federated Data Management

The increasingly collaborative, globalized nature of scientific research...
research
07/14/2022

Toward a Framework for Integrative, FAIR, and Reproducible Management of Data on the Dynamic Balance of Microbial Communities

The increasing volumes of data produced by high-throughput instruments c...
research
03/25/2020

Dynamo – Handling Scientific Data Across Sites and Storage Media

Dynamo is a full-stack software solution for scientific data management....
research
04/08/2021

A Brief Overview of the UML Scientific Profile

This article provides a brief overview of the UML SP (UML Scientific Pro...
research
05/22/2019

SciTokens: Demonstrating Capability-Based Access to Remote Scientific Data using HTCondor

The management of security credentials (e.g., passwords, secret keys) fo...

Please sign up or login with your details

Forgot password? Click here to reset