Adaptive Edge Content Delivery Networks for Web-Scale File Systems

07/13/2022
by   João Tiago, et al.
0

The InterPlanetary File System (IPFS) is an hyper-media distribution protocol, addressed by content and identities. It aims to make the web faster, safer, and more open. The JavaScript implementation of IPFS runs on the browser, benefiting from the mass adoption potential that it yields. Startrail takes advantage of the IPFS ecosystem and strives to further evolve it, making it more scalable and performant through the implementation of an adaptive network caching mechanism. Our solution aims to add resilience to IPFS and improve its overall scalability, by avoiding overloading the nodes providing highly popular content, particularly during flash-crowd-like conditions where popularity and demand grow suddenly. We add a novel crucial key component to enable an IPFS-based decentralized Content Distribution Network (CDN). Following a peer-to-peer architecture, it runs on a scalable, highly available network of untrusted nodes that distribute immutable and authenticated objects which are cached progressively towards the sources of requests.

READ FULL TEXT
research
02/27/2019

Adaptive Caching via Deep Reinforcement Learning

Caching is envisioned to play a critical role in next-generation content...
research
11/04/2017

OCDN: Oblivious Content Distribution Networks

As publishers increasingly use Content Distribution Networks (CDNs) to d...
research
07/07/2023

Improving Bitswap Privacy with Forwarding and Source Obfuscation

IPFS is a content-addressed decentralized peer-to-peer data network, usi...
research
03/02/2021

Spam Prevention Using zk-SNARKs for Anonymous Peer-to-Peer Content Sharing Systems

Decentralized unpermissioned peer-to-peer networks are inherently vulner...
research
08/11/2022

Design and Evaluation of IPFS: A Storage Layer for the Decentralized Web

Recent years have witnessed growing consolidation of web operations. For...
research
03/31/2020

Merkle-CRDTs: Merkle-DAGs meet CRDTs

We study Merkle-DAGs as a transport and persistence layer for Conflict-F...
research
10/02/2019

Content Delivery Through Hybrid Architecture in Video on Demand System

Peer-to-Peer (P2P) network needs architectural modification for smooth a...

Please sign up or login with your details

Forgot password? Click here to reset