TurboKV: Scaling Up The Performance of Distributed Key-Value Stores With In-Switch Coordination

10/26/2020
by   Hebatalla Eldakiky, et al.
0

The power and flexibility of software-defined networks lead to a programmable network infrastructure in which in-network computation can help accelerating the performance of applications. This can be achieved by offloading some computational tasks to the network. However, what kind of computational tasks should be delegated to the network to accelerate applications performance? In this paper, we propose a way to exploit the usage of programmable switches to scale up the performance of distributed key-value stores. Moreover, as a proof-of-concept, we propose TurboKV, an efficient distributed key-value store architecture that utilizes programmable switches as: 1) partition management nodes to store the key-value store partitions and replicas information; and 2) monitoring stations to measure the load of storage nodes, this monitoring information is used to balance the load among storage nodes. We also propose a key-based routing protocol to route the search queries of clients based on the requested keys to targeted storage nodes. Our experimental results of an initial prototype show that our proposed architecture improves the throughput and reduces the latency of distributed key-value stores when compared to the existing architectures.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/05/2022

Scale-friendly In-network Coordination

The programmability of modern network devices has led to innovative rese...
research
08/02/2021

Information Batteries: Storing Opportunity Power with Speculative Execution

Coping with the intermittency of renewables is a fundamental challenge, ...
research
05/29/2018

LaKe: An Energy Efficient, Low Latency, Accelerated Key-Value Store

Key-value store is a popular type of cloud computing applications. The p...
research
06/05/2020

Achieving High Throughput and Elasticity in a Larger-than-Memory Store

Millions of sensors, mobile applications and machines are now generating...
research
04/03/2021

Nova-LSM: A Distributed, Component-based LSM-tree Key-value Store

The cloud infrastructure motivates disaggregation of monolithic data sto...
research
09/25/2018

Network Coding for Critical Infrastructure Networks

The applications in the critical infrastructure systems pose simultaneou...
research
09/01/2018

Eliminating Boundaries in Cloud Storage with Anna

In this paper, we describe how we extended a distributed key-value store...

Please sign up or login with your details

Forgot password? Click here to reset