Sketch for traffic measurement: design, optimization, application and implementation

12/14/2020
by   Shangsen Li, et al.
0

Network measurement probes the underlying network to support upper-level decisions such as network management, network update, network maintenance, network defense and beyond. Due to the massive, speedy, unpredictable features of network flows, sketches are widely implemented in measurement nodes to record the frequency or estimate the cardinality of flows approximately. At their cores, sketches usually maintain one or multiple counter array(s), and relies on hash functions to select the counter(s) for each flow. Then the space-efficient sketches from the distributed measurement nodes are aggregated to provide statistics of the undergoing flows. Currently, tremendous redesigns and optimizations have been proposed to further improve the sketches for better network measurement performance. However, the existing reviews or surveys mainly focus on one particular aspect of measurement tasks. Researchers and engineers in the network measurement community desire an all-in-one survey which covers the whole processing pipeline of sketch-based network measurement. To this end, we present the first comprehensive survey in this area. We first introduce the preparation of flows for measurement, then detail the most recent investigations of design, aggregation, decoding, application and implementation of sketches for network measurement. To summary the existing efforts, we conduct an in-depth study of the existing literature, covering more than 80 sketch designs and optimization strategies. Furthermore, we conduct a comprehensive analysis and qualitative/quantitative comparison of the sketch designs. Finally, we highlight the open issues for future sketch-based network measurement research.

READ FULL TEXT

page 1

page 3

page 9

research
10/23/2019

A Fast and Compact Invertible Sketch for Network-Wide Heavy Flow Detection

Fast detection of heavy flows (e.g., heavy hitters and heavy changers) i...
research
04/13/2018

Optimizing Bloom Filter: Challenges, Solutions, and Comparisons

Bloom filter (BF) has been widely used to support membership query, i.e....
research
05/08/2019

Locality-Sensitive Sketching for Resilient Network Flow Monitoring

Network monitoring is vital in modern clouds and data center networks fo...
research
12/09/2022

DUNE: Improving Accuracy for Sketch-INT Network Measurement Systems

In-band Network Telemetry (INT) and sketching algorithms are two promisi...
research
12/05/2018

HashFlow For Better Flow Record Collection

Collecting flow records is a common practice of network operators and re...
research
01/02/2023

ChameleMon: Shifting Measurement Attention as Network State Changes

Flow-level network measurement is critical to many network applications....

Please sign up or login with your details

Forgot password? Click here to reset