Academic Storage Cluster

12/13/2021
by   Alexander von Tottleben, et al.
0

Decentralized storage is still rarely used in an academic and educational environment, although it offers better availability than conventional systems. It still happens that data is not available at a certain time due to heavy load or maintenance on university servers. A decentralized solution can help keep the data available and distribute the load among several peers. In our experiment, we created a cluster of containers in Docker to evaluate a private IPFS cluster for an academic data store focusing on availability, GET/PUT performance, and storage needs. As sample data, we used PDF files to analyze the data transport in our peer-to-peer network with Wireshark. We found that a bandwidth of at least 100 kbit/s is required for IPFS to function but recommend at least 1000 kbit/s for smooth operation. Also, the hard disk and memory size should be adapted to the data. Other limiting factors such as CPU power and delay in the internet connection did not affect the operation of the IPFS cluster.

READ FULL TEXT

page 1

page 2

research
10/23/2022

Kadabra: Adapting Kademlia for the Decentralized Web

Blockchains have become the catalyst for a growing movement to create a ...
research
04/17/2018

Simplex Queues for Hot-Data Download

In cloud storage systems, hot data is usually replicated over multiple n...
research
06/07/2023

Decentralized Technologies for AI Hubs

AI requires heavy amounts of storage and compute with assets that are co...
research
08/15/2022

Fair Incentivization of Bandwidth Sharing in Decentralized Storage Networks

Peer-to-peer (p2p) networks are not independent of their peers, and the ...
research
07/28/2019

Decentralized utility- and locality-aware replication for heterogeneous DHT-based P2P cloud storage systems

As a Distributed Hash Table (DHT), Skip Graph routing overlays are explo...
research
10/29/2022

Libraries, Integrations and Hubs for Decentralized AI using IPFS

AI requires heavy amounts of storage and compute. As a result, AI develo...
research
04/10/2023

SNIPS: Succinct Proof of Storage for Efficient Data Synchronization in Decentralized Storage Systems

Data synchronization in decentralized storage systems is essential to gu...

Please sign up or login with your details

Forgot password? Click here to reset