Intra-process Caching and Reuse of Threads

by   Dave Dice, et al.

Creating and destroying threads on modern Linux systems incurs high latency, absent concurrency, and fails to scale as we increase concurrency. To address this concern we introduce a process-local cache of idle threads. Specifically, instead of destroying a thread when it terminates, we cache and then recycle that thread in the context of subsequent thread creation requests. This approach shows significant promise in various applications and benchmarks that create and destroy threads rapidly and illustrates the need for and potential benefits of improved concurrency infrastructure. With caching, the cost of creating a new thread drops by almost an order of magnitude. As our experiments demonstrate, this results in significant performance improvements for multiple applications that aggressively create and destroy numerous threads.



page 1

page 2

page 3


Lower Bounds for Caching with Delayed Hits

Caches are a fundamental component of latency-sensitive computer systems...

ECI-Cache: A High-Endurance and Cost-Efficient I/O Caching Scheme for Virtualized Platforms

In recent years, high interest in using Virtual Machines (VMs) in data c...

Performance of Caching-Based D2D Video Distribution with Measured Popularity Distributions

On-demand video accounts for the majority of wireless data traffic. Vide...

ETICA: Efficient Two-Level I/O Caching Architecture for Virtualized Platforms

In this paper, we propose an Efficient Two-Level I/O Caching Architectur...

Understanding Application-Level Caching in Web Applications: A Comprehensive Introduction and Survey of State-of-the-Art

A new form of caching, namely application-level caching, has been recent...

Asymptotic Miss Ratio of LRU Caching with Consistent Hashing

To efficiently scale data caching infrastructure to support emerging big...

Rache: Radix-additive caching for homomorphic encryption

One of the biggest concerns for many applications in cloud computing lie...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.