QStack: Re-architecting User-space Network Stack to Optimize CPU Efficiency and Service Quality

10/16/2022
by   WL Zhang, et al.
0

TCP/IP network stack is irreplaceable for Web services in datacenter front-end servers, and the demand for which is growing rapidly for emerging high concurrency network service applications (including Internet, Internet of Things, mobile Internet, etc.) especially. The existing network stack schemes often face the dilemma between the data center server resource utilization (i.e., high CPU efficiency) and application service quality (i.e., low tail latency). We break this dilemma via a flexible architectural design QStack, which simultaneously achieves CPU efficiency and low tail latency in user-space network stack for front-end datacenter server. QStack proposes elastic framework and application definable full-datapath priority, such that the network stack collaboration among CPU cores horizontally and coordination across network layers in fine grained vertically on demand. We prototype QStack on commodity servers. Testbed experiments demonstrate the effectiveness of QStack over state-of-the-art user-space network stack designs.

READ FULL TEXT

page 4

page 5

page 6

research
10/23/2020

The nanoPU: Redesigning the CPU-Network Interface to Minimize RPC Tail Latency

The nanoPU is a new networking-optimized CPU designed to minimize tail l...
research
06/02/2021

Dagger: Accelerating RPCs in Cloud Microservices Through Tightly-Coupled Reconfigurable NICs

The ongoing shift of cloud services from monolithic designs to microserv...
research
08/19/2020

FIRM: An Intelligent Fine-Grained Resource Management Framework for SLO-Oriented Microservices

Modern user-facing latency-sensitive web services include numerous distr...
research
10/12/2020

RackSched: A Microsecond-Scale Scheduler for Rack-Scale Computers (Technical Report)

Low-latency online services have strict Service Level Objectives (SLOs) ...
research
02/28/2023

Protected Data Plane OS Using Memory Protection Keys and Lightweight Activation

Increasing data center network speed coupled with application requiremen...
research
09/07/2021

Memory at Your Service: Fast Memory Allocation for Latency-critical Services

Co-location and memory sharing between latency-critical services, such a...
research
06/18/2023

A Survey on User-Space Storage and Its Implementations

The storage stack in the traditional operating system is primarily optim...

Please sign up or login with your details

Forgot password? Click here to reset