A Survey on the Evolution of Stream Processing Systems

08/03/2020
by   Marios Fragkoulis, et al.
0

Stream processing has been an active research field for more than 20 years, but it is now witnessing its prime time due to recent successful efforts by the research community and numerous worldwide open-source communities. This survey provides a comprehensive overview of fundamental aspects of stream processing systems and their evolution in the functional areas of out-of-order data management, state management, fault tolerance, high availability, load management, elasticity, and reconfiguration. We review noteworthy past research findings, outline the similarities and differences between early ('00-'10) and modern ('11-'18) streaming systems, and discuss recent trends and open problems.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 2

page 8

page 11

page 12

page 13

page 14

page 18

page 27

11/12/2018

On the Performance and Convergence of Distributed Stream Processing via Approximate Fault Tolerance

Fault tolerance is critical for distributed stream processing systems, y...
12/18/2018

LSM-based Storage Techniques: A Survey

In recent years, Log-Structured Merge-trees (LSM-trees) have been widely...
01/16/2020

Hardware-Conscious Stream Processing: A Survey

Data stream processing systems (DSPSs) enable users to express and run s...
04/16/2021

The Need for Holistic Technical Debt Management across the Value Stream: Lessons Learnt and Open Challenges

The long lifetime and the evolving nature of industrial products make th...
03/25/2020

A Survey on Trajectory Data Management, Analytics, and Learning

Recent advances in sensor and mobile devices have enabled an unprecedent...
01/28/2019

A Comprehensive Survey on Parallelization and Elasticity in Stream Processing

Stream Processing (SP) has evolved as the leading paradigm to process an...
12/02/2019

SSNdesign – an R package for pseudo-Bayesian optimal and adaptive sampling designs on stream networks

Streams and rivers are biodiverse and provide valuable ecosystem service...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.