DeepAI AI Chat
Log In Sign Up

LEGOStore: A Linearizable Geo-Distributed Store Combining Replication and Erasure Coding

11/23/2021
by   HamidReza Zare, et al.
0

We design and implement LEGOStore, an erasure coding (EC) based linearizable data store over geo-distributed public cloud data centers (DCs). For such a data store, the confluence of the following factors opens up opportunities for EC to be latency-competitive with replication: (a) the necessity of communicating with remote DCs to tolerate entire DC failures and implement linearizability; and (b) the emergence of DCs near most large population centers. LEGOStore employs an optimization framework that, for a given object, carefully chooses among replication and EC, as well as among various DC placements to minimize overall costs. To handle workload dynamism, LEGOStore employs a novel agile reconfiguration protocol. Our evaluation using a LEGOStore prototype spanning 9 Google Cloud Platform DCs demonstrates the efficacy of our ideas. We observe cost savings ranging from moderate (5-20%) to significant (60%) over baselines representing the state of the art while meeting tail latency SLOs. Our reconfiguration protocol is able to transition key placements in 3 to 4 inter-DC RTTs (< 1s in our experiments), allowing for agile adaptation to dynamic conditions.

READ FULL TEXT

page 17

page 41

11/21/2017

Non-uniform Replication

Replication is a key technique in the design of efficient and reliable d...
12/20/2022

Tuning the Tail Latency of Distributed Queries Using Replication

Querying graph data with low latency is an important requirement in appl...
06/18/2019

SeeMoRe: A Fault-Tolerant Protocol for Hybrid Cloud Environments

Large scale data management systems utilize State Machine Replication to...
10/31/2019

MQTT-ST: a Spanning Tree Protocol for Distributed MQTT Brokers

MQTT, one of the most popular protocols for the IoT, works according to ...
05/05/2020

Peak Power Shaving for Reduced Electricity Costs in Cloud Data Centers: Opportunities and Challenges

An electricity bill of a data center (DC) is determined not only by how ...
07/04/2014

RepNet: Cutting Tail Latency in Data Center Networks with Flow Replication

Data center networks need to provide low latency, especially at the tail...
04/29/2020

Evacuação de Dados em Nuvens Ópticas com base no SLA sob Cenário de Desastre

The popularization of cloud computing has provided the emergence of larg...