On SDN-Enabled Online and Dynamic Bandwidth Allocation for Stream Analytics

by   Walid Aljoby, et al.

Data communication in cloud-based distributed stream data analytics often involves a collection of parallel and pipelined TCP flows. As the standard TCP congestion control mechanism is designed for achieving "fairness" among competing flows and is agnostic to the application layer contexts, the bandwidth allocation among a set of TCP flows traversing bottleneck links often leads to sub-optimal application-layer performance measures, e.g., stream processing throughput or average tuple complete latency. Motivated by this and enabled by the rapid development of the Software-Defined Networking (SDN) techniques, in this paper, we re-investigate the design space of the bandwidth allocation problem and propose a cross-layer framework which utilizes the additional information obtained from the application layer and provides on-the-fly and dynamic bandwidth adjustment algorithms for helping the stream analytics applications achieving better performance during the runtime. We implement a prototype cross-layer bandwidth allocation framework based on a popular open-source distributed stream processing platform, Apache Storm, together with the OpenDaylight controller, and carry out extensive experiments with real-world analytical workloads on top of a local cluster consisting of 10 workstations interconnected by a SDN-enabled switch. The experiment results clearly validate the effectiveness and efficiency of our proposed framework and algorithms.


A SDN/OpenFlow Framework for Dynamic Resource Allocation based on Bandwidth Allocation Model

The communication network context in actual systems like 5G, cloud and I...

Blockchain-Powered Software Defined Network-Enabled Networking Infrastructure for Cloud Management

Cloud architecture has become a valuable solution for different applicat...

Isolating SDN Control Traffic with Layer-2 Slicing in 6TiSCH Industrial IoT Networks

Recent standardization efforts in IEEE 802.15.4-2015 Time Scheduled Chan...

Terra: Scalable Cross-Layer GDA Optimizations

Geo-distributed analytics (GDA) frameworks transfer large datasets over ...

Wide Area Network Autoscaling for Cloud Applications

Modern cloud orchestrators like Kubernetes provide a versatile and robus...

DiffPerf: Towards Performance Differentiation and Optimization with SDN Implementation

Continuing the current trend, Internet traffic is expected to grow signi...

Managing IEC 61850 Message Exchange for SDN-Controlled Cognitive Communication Resource Allocation in the Smart Grid

The IEC 61850 standard is being largely used in the Smart Grid (SG) cont...

Please sign up or login with your details

Forgot password? Click here to reset