Rack-Aware Regenerating Codes with Fewer Helper Racks

01/21/2021
by   Zhifang Zhang, et al.
0

We consider the rack-aware storage system where n nodes are organized in n̅ racks each containing u nodes, and any k nodes can retrieve the stored file. Moreover, any single node erasure can be recovered by downloading data from d̅ helper racks as well as the remaining u-1 nodes in the same rack. Previous work mostly focuses on minimizing the cross-rack repair bandwidth under the condition d̅≥k̅, where k̅=⌊k/u⌋. However, d̅≥k̅ is not an intrinsic condition for the rack-aware storage model. In this paper, we establish a tradeoff between the storage overhead and cross-rack repair bandwidth for the particularly interesting case d̅<k̅. Furthermore, we present explicit constructions of codes with parameters lying on the tradeoff curve respectively at the minimum storage point and minimum bandwidth point. The codes are scalar or have sub-packetization d̅, and operate over finite fields of size comparable to n. Regarding d̅ as the repair degree, these codes combine the advantage of regenerating codes in minimizing the repair bandwidth and that of locally repairable codes in reducing the repair degree. Moreover, they also abandon the restriction of MBR codes having storage overhead no less than 2× and that of high-rate MSR codes having exponential sub-packetization level.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/02/2021

Explicit Construction of Minimum Bandwidth Rack-Aware Regenerating Codes

In large data centers, storage nodes are organized in racks, and the cro...
research
06/07/2021

Rack-Aware Regenerating Codes with Multiple Erasure Tolerance

In a modern distributed storage system, storage nodes are organized in r...
research
03/29/2021

Explicit Construction of Minimum Storage Rack-Aware Regenerating Codes for All Parameters

We consider the rack-aware storage system where n=n̅u nodes are organize...
research
02/12/2018

Rack-Aware Regenerating Codes for Data Centers

Erasure coding is widely used for massive storage in data centers to ach...
research
11/02/2022

Node repair on connected graphs, Part II

We continue our study of regenerating codes in distributed storage syste...
research
03/09/2018

Network Traffic Driven Storage Repair

Recently we constructed an explicit family of locally repairable and loc...
research
01/06/2018

A Class of MSR Codes for Clustered Distributed Storage

Clustered distributed storage models real data centers where intra- and ...

Please sign up or login with your details

Forgot password? Click here to reset