HNLB: Utilizing Hardware Matching Capabilities of NICs for Offloading Stateful Load Balancers

02/09/2019
by   Raphael Durner, et al.
0

In order to scale web or other services, the load on single instances of the respective service has to be balanced. Many services are stateful such that packets belonging to the same connection must be delivered to the same instance. This requires stateful load balancers which are mostly implemented in software. On the one hand, modern packet processing frameworks supporting software load balancers, such as the Data Plane Development Kit (DPDK), deliver high performance compared to older approaches. On the other hand, common Network Interface Cards (NICs) provide additional matching capabilities that can be utilized for increasing the performance even further and in turn reduce the necessary server resources. In fact, offloading the packet matching to hardware can free up CPU cycles of the servers. Therefore, in this work, we propose the Hybrid NIC-offloading Load Balancer (HNLB), a high performance hybrid hardware-software load balancer, utilizing the NIC-offloading hardware matching capabilities. The results of our performance evaluations show that the throughput using NIC offloading can be increased by up to 50 implementation. Furthermore, we investigated the limitations of our proposed approach, e.g., the limited number of possible concurrent connections.

READ FULL TEXT

page 1

page 4

research
11/06/2020

Study of Automatic GPU Offloading Method from Various Language Applications

In recent years, utilization of heterogeneous hardware other than small ...
research
10/07/2020

PsPIN: A high-performance low-power architecture for flexible in-network compute

The capacity of offloading data and control tasks to the network is beco...
research
08/05/2019

Concury: A Fast and Light-weighted Software Load Balancer

A load balancer (LB) is a vital network function for cloud services to b...
research
08/20/2021

Power Reduction of Automatic Heterogeneous Device Offloading

In recent years, utilization of heterogeneous hardware other than small ...
research
03/08/2023

MiddleNet: A Unified, High-Performance NFV and Middlebox Framework with eBPF and DPDK

Traditional network resident functions (e.g., firewalls, network address...
research
03/24/2021

Metronome: adaptive and precise intermittent packet retrieval in DPDK

DPDK (Data Plane Development Kit) is arguably today's most employed fram...
research
06/12/2018

P4CEP: Towards In-Network Complex Event Processing

In-network computing using programmable networking hardware is a strong ...

Please sign up or login with your details

Forgot password? Click here to reset