SNIPS: Succinct Proof of Storage for Efficient Data Synchronization in Decentralized Storage Systems

04/10/2023
by   Racin Nygaard, et al.
0

Data synchronization in decentralized storage systems is essential to guarantee sufficient redundancy to prevent data loss. We present SNIPS, the first succinct proof of storage algorithm for synchronizing storage peers. A peer constructs a proof for its stored chunks and sends it to verifier peers. A verifier queries the proof to identify and subsequently requests missing chunks. The proof is succinct, supports membership queries, and requires only a few bits per chunk. We evaluated our SNIPS algorithm on a cluster of 1000 peers running Ethereum Swarm. Our results show that SNIPS reduces the amount of synchronization data by three orders of magnitude compared to the state-of-the-art. Additionally, creating and verifying a proof is linear with the number of chunks and typically requires only tens of microseconds per chunk. These qualities are vital for our use case, as we envision running SNIPS frequently to maintain sufficient redundancy consistently.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/05/2019

[Invited talk] Building a Disaster-resilient Storage Layer for Next Generation Networks: The Role of Redundancy

Blockchain is the driving force behind a myriad of decentralized applica...
research
04/20/2020

Vilamb: Low Overhead Asynchronous Redundancy for Direct Access NVM

Vilamb provides efficient asynchronous systemredundancy for direct acces...
research
04/28/2021

Towards Decentralized Complex Queries over Distributed Ledgers: a Data Marketplace Use-case

Distributed Ledger Technologies (DLT) and Decentralized File Storages (D...
research
10/23/2022

Kadabra: Adapting Kademlia for the Decentralized Web

Blockchains have become the catalyst for a growing movement to create a ...
research
05/21/2021

Exploring Ethereum's Data Stores: A Cost and Performance Comparison

The cost of using a blockchain infrastructure as well as the time requir...
research
10/29/2022

Libraries, Integrations and Hubs for Decentralized AI using IPFS

AI requires heavy amounts of storage and compute. As a result, AI develo...
research
12/13/2021

Academic Storage Cluster

Decentralized storage is still rarely used in an academic and educationa...

Please sign up or login with your details

Forgot password? Click here to reset