ZipLine: In-Network Compression at Line Speed

01/13/2021
by   Sébastien Vaucher, et al.
0

Network appliances continue to offer novel opportunities to offload processing from computing nodes directly into the data plane. One popular concern of network operators and their customers is to move data increasingly faster. A common technique to increase data throughput is to compress it before its transmission. However, this requires compression of the data – a time and energy demanding pre-processing phase – and decompression upon reception – a similarly resource consuming operation. Moreover, if multiple nodes transfer similar data chunks across the network hop (e.g., a given pair of switches), each node effectively wastes resources by executing similar steps. This paper proposes ZipLine, an approach to design and implement (de)compression at line speed leveraging the Tofino hardware platform which is programmable using the P4_16 language. We report on lessons learned while building the system and show throughput, latency and compression measurements on synthetic and real-world traces, showcasing the benefits and trade-offs of our design.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/17/2023

CStream: Parallel Data Stream Compression on Multicore Edge Devices

In the burgeoning realm of Internet of Things (IoT) applications on edge...
research
03/11/2019

Security, Performance and Energy Trade-offs of Hardware-assisted Memory Protection Mechanisms

The deployment of large-scale distributed systems, e.g., publish-subscri...
research
08/05/2022

Scale-friendly In-network Coordination

The programmability of modern network devices has led to innovative rese...
research
06/24/2021

CEAZ: Accelerating Parallel I/O via Hardware-Algorithm Co-Design of Efficient and Adaptive Lossy Compression

As supercomputers continue to grow to exascale, the amount of data that ...
research
06/22/2018

Control Plane Compression

We develop an algorithm capable of compressing large networks into a sma...
research
09/05/2019

Random Linear Network Coding on Programmable Switches

By extending the traditional store-and-forward mechanism, network coding...
research
06/29/2021

Flare: Flexible In-Network Allreduce

The allreduce operation is one of the most commonly used communication r...

Please sign up or login with your details

Forgot password? Click here to reset