Internet Traffic Volumes Are Not Gaussian – They Are Log-Normal: An 18-Year Longitudinal Study With Implications for Modelling and Prediction

07/17/2020
by   Mohammed Alasmar, et al.
0

Getting good statistical models of traffic on network links is a well-known, often-studied problem. A lot of attention has been given to correlation patterns and flow duration. The distribution of the amount of traffic per unit time is an equally important but less studied problem. We study a large number of traffic traces from many different networks including academic, commercial and residential networks using state-of-the-art statistical techniques. We show that traffic obeys the log-normal distribution which is a better fit than the Gaussian distribution commonly claimed in the literature. We also investigate an alternative heavy-tailed distribution (the Weibull) and show that its performance is better than Gaussian but worse than log-normal. We examine anomalous traces which exhibit a poor fit for all distributions tried and show that this is often due to traffic outages or links that hit maximum capacity. We demonstrate that the data we look at is stationary if we consider samples of 15 minutes or even one hour long. This gives confidence that we can use the distributions for estimation and modelling purposes. We demonstrate the utility of our findings in two contexts: predicting that the proportion of time traffic will exceed a given level (for service level agreement or link capacity estimation) and predicting 95th percentile pricing. We also show that the log-normal distribution is a better predictor than Gaussian or Weibull distributions in both contexts.

READ FULL TEXT

page 1

page 7

page 8

page 9

page 11

research
02/11/2019

On the Distribution of Traffic Volumes in the Internet and its Implications

Getting good statistical models of traffic on network links is a well-kn...
research
05/01/2020

Multivariate Log-Skewed Distributions with normal kernel and their Applications

We introduce two classes of multivariate log skewed distributions with n...
research
02/04/2022

A useful family of fat-tailed distributions

It is argued that there is a need for fat-tailed distributions that beco...
research
11/26/2022

Unit-log-symmetric models: Characterization, statistical properties and its use in analyzing internet access data

We present here a unit-log-symmetric model based on the bivariate log-sy...
research
01/04/2023

Comparison of Azzalini and Geometric Skew Normal Distributions Under Bayesian Paradigm

Skewed generalizations of the normal distribution have been a topic of g...
research
01/05/2018

Transformation of arbitrary distributions to the normal distribution with application to EEG test-retest reliability

Many variables in the social, physical, and biosciences, including neuro...

Please sign up or login with your details

Forgot password? Click here to reset