Architecture of Distributed Data Storage for Astroparticle Physics

11/06/2018
by   Alexander Kryukov, et al.
0

For the successful development of the astrophysics and, accordingly, for obtaining more complete knowledge of the Universe, it is extremely important to combine and comprehensively analyze information of various types (e.g., about charged cosmic particles, gamma rays, neutrinos, etc.) obtained by using divers large-scale experimental setups located throughout the world. It is obvious that all kinds of activities must be performed continually across all stages of the data life cycle to help support effective data management, in particular, the collection and storage of data, its processing and analysis, refining the physical model, making preparations for publication, and data reprocessing taking refinement into account. In this paper we present a general approach to construction and the architecture of a system to be able to collect, store, and provide users' access to astrophysical data. We also suggest a new approach to the construction of a metadata registry based on the blockchain technology.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/04/2019

Development of a data infrastructure for a global data and analysis center in astroparticle physics

Nowadays astroparticle physics faces a rapid data volume increase. Meanw...
research
07/16/2019

Distributed data storage for modern astroparticle physics experiments

The German-Russian Astroparticle Data Life Cycle Initiative is an intern...
research
05/16/2019

StashCache: A Distributed Caching Federation for the Open Science Grid

Data distribution for opportunistic users is challenging as they neither...
research
11/30/2018

The Approach to Managing Provenance Metadata and Data Access Rights in Distributed Storage Using the Hyperledger Blockchain Platform

The paper suggests a new approach based on blockchain technologies and s...
research
07/23/2021

ArchaeoDAL: A Data Lake for Archaeological Data Management and Analytics

With new emerging technologies, such as satellites and drones, archaeolo...
research
05/02/2022

A Case Study on Parallel HDF5 Dataset Concatenation for High Energy Physics Data Analysis

In High Energy Physics (HEP), experimentalists generate large volumes of...
research
01/07/2021

Towards a Smart Data Processing and Storage Model

In several domains it is crucial to store and manipulate data whose orig...

Please sign up or login with your details

Forgot password? Click here to reset