A Comprehensive Survey on Parallelization and Elasticity in Stream Processing

01/28/2019
by   Henriette Röger, et al.
0

Stream Processing (SP) has evolved as the leading paradigm to process and gain value from the high volume of streaming data produced e.g. in the domain of the Internet of Things. An SP system is a middleware that deploys a network of operators between data sources, such as sensors, and the consuming applications. SP systems typically face intense and highly dynamic data streams. Parallelization and elasticity enables SP systems to process these streams with continuously high quality of service. The current research landscape provides a broad spectrum of methods for parallelization and elasticity in SP. Each method makes specific assumptions and focuses on particular aspects of the problem. However, the literature lacks a comprehensive overview and categorization of the state of the art in SP parallelization and elasticity, which is necessary to consolidate the state of the research and to plan future research directions on this basis. Therefore, in this survey, we study the literature and develop a classification of current methods for both parallelization and elasticity in SP systems.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/16/2020

Hardware-Conscious Stream Processing: A Survey

Data stream processing systems (DSPSs) enable users to express and run s...
research
08/14/2018

Stream Reasoning on Expressive Logics

Data streams occur widely in various real world applications. The resear...
research
12/11/2018

A Scalable and Robust Framework for Data Stream Ingestion

An essential part of building a data-driven organization is the ability ...
research
08/01/2023

Learning from Hypervectors: A Survey on Hypervector Encoding

Hyperdimensional computing (HDC) is an emerging computing paradigm that ...
research
08/03/2020

A Survey on the Evolution of Stream Processing Systems

Stream processing has been an active research field for more than 20 yea...
research
02/14/2020

DSCEP: An Infrastructure for Distributed Semantic Complex Event Processing

Today most applications continuously produce information under the form ...
research
06/15/2021

Faster than LASER – Towards Stream Reasoning with Deep Neural Networks

With the constant increase of available data in various domains, such as...

Please sign up or login with your details

Forgot password? Click here to reset