AnchorHash: A Scalable Consistent Hash

12/23/2018
by   Gal Mendelson, et al.
0

Consistent hashing (CH) is a central building block in many networking applications, from datacenter load-balancing to distributed storage. Unfortunately, state-of-the-art CH solutions cannot ensure full consistency under arbitrary changes and/or cannot scale while maintaining reasonable memory footprints and update times. We present AnchorHash, a scalable and fully-consistent hashing algorithm. AnchorHash achieves high key lookup rates, a low memory footprint, and low update times. We formally establish its strong theoretical guarantees, and present advanced implementations with a memory footprint of only a few bytes per resource. Moreover, extensive evaluations indicate that it outperforms state-of-the-art algorithms, and that it can scale on a single core to 100 million resources while still achieving a key lookup rate of more than 15 million keys per second.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 1

page 2

page 3

page 4

07/16/2021

DxHash: A Scalable Consistent Hash Based on the Pseudo-Random Sequence

Consistent hasing has played a fundamental role as a data router and a l...
05/08/2018

Round-Hashing for Data Storage: Distributed Servers and External-Memory Tables

This paper proposes round-hashing, which is suitable for data storage on...
03/16/2020

Dash: Scalable Hashing on Persistent Memory

Byte-addressable persistent memory (PM) brings hash tables the potential...
06/03/2018

Efficient Time-Evolving Stream Processing at Scale

Time-evolving stream datasets exist ubiquitously in many real-world appl...
05/11/2017

ROCKER: A Refinement Operator for Key Discovery

The Linked Data principles provide a decentral approach for publishing s...
10/11/2018

A Comparative Study of Consistent Snapshot Algorithms for Main-Memory Database Systems

In-memory databases (IMDBs) are gaining increasing popularity in big dat...
07/14/2021

Consistent RDMA-Friendly Hashing on Remote Persistent Memory

Coalescing RDMA and Persistent Memory (PM) delivers high end-to-end perf...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.