DeepAI AI Chat
Log In Sign Up

LEGOStore: A Linearizable Geo-Distributed Store Combining Replication and Erasure Coding

by   HamidReza Zare, et al.

We design and implement LEGOStore, an erasure coding (EC) based linearizable data store over geo-distributed public cloud data centers (DCs). For such a data store, the confluence of the following factors opens up opportunities for EC to be latency-competitive with replication: (a) the necessity of communicating with remote DCs to tolerate entire DC failures and implement linearizability; and (b) the emergence of DCs near most large population centers. LEGOStore employs an optimization framework that, for a given object, carefully chooses among replication and EC, as well as among various DC placements to minimize overall costs. To handle workload dynamism, LEGOStore employs a novel agile reconfiguration protocol. Our evaluation using a LEGOStore prototype spanning 9 Google Cloud Platform DCs demonstrates the efficacy of our ideas. We observe cost savings ranging from moderate (5-20%) to significant (60%) over baselines representing the state of the art while meeting tail latency SLOs. Our reconfiguration protocol is able to transition key placements in 3 to 4 inter-DC RTTs (< 1s in our experiments), allowing for agile adaptation to dynamic conditions.


page 17

page 41


Non-uniform Replication

Replication is a key technique in the design of efficient and reliable d...

Tuning the Tail Latency of Distributed Queries Using Replication

Querying graph data with low latency is an important requirement in appl...

SeeMoRe: A Fault-Tolerant Protocol for Hybrid Cloud Environments

Large scale data management systems utilize State Machine Replication to...

MQTT-ST: a Spanning Tree Protocol for Distributed MQTT Brokers

MQTT, one of the most popular protocols for the IoT, works according to ...

Peak Power Shaving for Reduced Electricity Costs in Cloud Data Centers: Opportunities and Challenges

An electricity bill of a data center (DC) is determined not only by how ...

RepNet: Cutting Tail Latency in Data Center Networks with Flow Replication

Data center networks need to provide low latency, especially at the tail...

Evacuação de Dados em Nuvens Ópticas com base no SLA sob Cenário de Desastre

The popularization of cloud computing has provided the emergence of larg...