Low-Rate Overuse Flow Tracer (LOFT): An Efficient and Scalable Algorithm for Detecting Overuse Flows

by   Simon Scherrer, et al.

Current probabilistic flow-size monitoring can only detect heavy hitters (e.g., flows utilizing 10 times their permitted bandwidth), but cannot detect smaller overuse (e.g., flows utilizing 50-100 bandwidth). Thus, these systems lack accuracy in the challenging environment of high-throughput packet processing, where fast-memory resources are scarce. Nevertheless, many applications rely on accurate flow-size estimation, e.g. for network monitoring, anomaly detection and Quality of Service. We design, analyze, implement, and evaluate LOFT, a new approach for efficiently detecting overuse flows that achieves dramatically better properties than prior work. LOFT can detect 1.5x overuse flows in one second, whereas prior approaches fail to detect 2x overuse flows within a timeout of 300 seconds. We demonstrate LOFT's suitability for high-speed packet processing with implementations in the DPDK framework and on an FPGA.



There are no comments yet.


page 2

page 4

page 5

page 6

page 8

page 9

page 12

page 13


Memory-Efficient Performance Monitoring on Programmable Switches with Lean Algorithms

Network performance problems are notoriously difficult to diagnose. Prio...

Why Normalizing Flows Fail to Detect Out-of-Distribution Data

Detecting out-of-distribution (OOD) data is crucial for robust machine l...

HashFlow For Better Flow Record Collection

Collecting flow records is a common practice of network operators and re...

Scaling Up Anomaly Detection Using In-DRAM Working Set of Active Flows Table

In the zettabyte era, per-flow measurement becomes more challenging owin...

LightFDG: An Integrated Approach to Flow Detection and Grooming in Optical Wireless DCNs

LightFDG is an integrated approach to flow detection (FD) and flow groom...

Fundamental Limits of Invisible Flow Fingerprinting

Network flow fingerprinting can be used to de-anonymize communications o...

HTBQueue: A Hierarchical Token Bucket Implementation for the OMNeT++/INET Framework

The hierarchical token bucket (HTB) algorithm allows to specify per-flow...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.