An Exponential Lower Bound on the Sub-Packetization of MSR Codes

01/16/2019
by   Omar Alrabiah, et al.
0

An (n,k,ℓ)-vector MDS code is a F-linear subspace of (F^ℓ)^n (for some field F) of dimension kℓ, such that any k (vector) symbols of the codeword suffice to determine the remaining r=n-k (vector) symbols. The length ℓ of each codeword symbol is called the sub-packetization of the code. Such a code is called minimum storage regenerating (MSR), if any single symbol of a codeword can be recovered by downloading ℓ/r field elements (which is known to be the least possible) from each of the other symbols. MSR codes are attractive for use in distributed storage systems, and by now a variety of ingenious constructions of MSR codes are available. However, they all suffer from exponentially large sub-packetization ℓ≳ r^k/r. Our main result is an almost tight lower bound showing that for an MSR code, one must have ℓ>(Ω(k/r)). Previously, a lower bound of ≈(√(k/r)), and a tight lower bound for a restricted class of "optimal access" MSR codes, were known. Our work settles a central open question concerning MSR codes that has received much attention. Further our proof is really short, hinging on one key definition that is somewhat inspired by Galois theory.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/12/2018

Erasure Codes for Distributed Storage: Tight Bounds and Matching Constructions

This thesis makes several significant contributions to the theory of bot...
research
02/06/2018

Erasure correction of scalar codes in the presence of stragglers

Recent advances in coding for distributed storage systems have reignited...
research
09/07/2022

Explicit Low-Bandwidth Evaluation Schemes for Weighted Sums of Reed-Solomon-Coded Symbols

Motivated by applications in distributed storage, distributed computing,...
research
05/27/2019

Subspace code constructions

We improve on the lower bound of the maximum number of planes of PG(8,q...
research
06/28/2019

Access Balancing in Storage Systems by Labeling Partial Steiner Systems

Storage architectures ranging from minimum bandwidth regenerating encode...
research
10/27/2017

On Maximally Recoverable Local Reconstruction Codes

In recent years the explosion in the volumes of data being stored online...
research
08/28/2020

Bandwidth Cost of Code Conversions in Distributed Storage: Fundamental Limits and Optimal Constructions

Erasure codes have become an integral part of distributed storage system...

Please sign up or login with your details

Forgot password? Click here to reset