DeepAI AI Chat
Log In Sign Up

Storage Codes with Flexible Number of Nodes

by   Weiqi Li, et al.

This paper presents flexible storage codes, a class of error-correcting codes that can recover information from a flexible number of storage nodes. As a result, one can make a better use of the available storage nodes in the presence of unpredictable node failures and reduce the data access latency. Let us assume a storage system encodes kℓ information symbols over a finite field 𝔽 into n nodes, each of size ℓ symbols. The code is parameterized by a set of tuples {(R_j,k_j,ℓ_j): 1 ≤ j ≤ a}, satisfying k_1ℓ_1=k_2ℓ_2=...=k_aℓ_a and k_1>k_2>...>k_a = k, ℓ_a=ℓ, such that the information symbols can be reconstructed from any R_j nodes, each node accessing ℓ_j symbols. In other words, the code allows a flexible number of nodes for decoding to accommodate the variance in the data access time of the nodes. Code constructions are presented for different storage scenarios, including LRC (locally recoverable) codes, PMDS (partial MDS) codes, and MSR (minimum storage regenerating) codes. We analyze the latency of accessing information and perform simulations on Amazon clusters to show the efficiency of presented codes.


page 1

page 2

page 3

page 4

∙ 12/10/2021

Optimal Quaternary (r,delta)-Locally Repairable Codes Achieving the Singleton-type Bound

Locally repairable codes enables fast repair of node failure in a distri...
∙ 01/14/2019

Explicit constructions of MSR codes for clustered distributed storage: The rack-aware storage model

The paper is devoted to the problem of erasure coding in distributed sto...
∙ 02/23/2020

Treeplication: An Erasure Code for Distributed Full Recovery under the Random Multiset Channel

This paper presents a new erasure code called Treeplication designed for...
∙ 12/02/2018

Double and Triple Node-Erasure-Correcting Codes over Graphs

In this paper we study array-based codes over graphs for correcting mult...
∙ 12/02/2018

Double and Triple Erasure-Correcting-Codes over Graphs

In this paper we study array-based codes over graphs for correcting mult...
∙ 12/03/2018

QR code denoising using parallel Hopfield networks

We propose a novel algorithm for using Hopfield networks to denoise QR c...
∙ 06/30/2020

Multilinear Algebra for Minimum Storage Regenerating Codes

An (n, k, d, α)-MSR (minimum storage regeneration) code is a set of n no...