A Survey on the Evolution of Stream Processing Systems

08/03/2020
by   Marios Fragkoulis, et al.
0

Stream processing has been an active research field for more than 20 years, but it is now witnessing its prime time due to recent successful efforts by the research community and numerous worldwide open-source communities. This survey provides a comprehensive overview of fundamental aspects of stream processing systems and their evolution in the functional areas of out-of-order data management, state management, fault tolerance, high availability, load management, elasticity, and reconfiguration. We review noteworthy past research findings, outline the similarities and differences between early ('00-'10) and modern ('11-'18) streaming systems, and discuss recent trends and open problems.

READ FULL TEXT

page 2

page 8

page 11

page 12

page 13

page 14

page 18

page 27

research
11/12/2018

On the Performance and Convergence of Distributed Stream Processing via Approximate Fault Tolerance

Fault tolerance is critical for distributed stream processing systems, y...
research
08/21/2022

A Survey on Transactional Stream Processing

Transactional stream processing (TSP) has been increasingly gaining trac...
research
12/18/2018

LSM-based Storage Techniques: A Survey

In recent years, Log-Structured Merge-trees (LSM-trees) have been widely...
research
04/16/2021

The Need for Holistic Technical Debt Management across the Value Stream: Lessons Learnt and Open Challenges

The long lifetime and the evolving nature of industrial products make th...
research
03/25/2020

A Survey on Trajectory Data Management, Analytics, and Learning

Recent advances in sensor and mobile devices have enabled an unprecedent...
research
12/02/2019

SSNdesign – an R package for pseudo-Bayesian optimal and adaptive sampling designs on stream networks

Streams and rivers are biodiverse and provide valuable ecosystem service...
research
01/28/2019

A Comprehensive Survey on Parallelization and Elasticity in Stream Processing

Stream Processing (SP) has evolved as the leading paradigm to process an...

Please sign up or login with your details

Forgot password? Click here to reset