Architecture for Analysis of Streaming Data

05/02/2018
by   Sheik Hoque, et al.
0

While several attempts have been made to construct a scalable and flexible architecture for analysis of streaming data, no general model to tackle this task exists. Thus, our goal is to build a scalable and maintainable architecture for performing analytics on streaming data. To reach this goal, we introduce a 7-layered architecture consisting of microservices and publish-subscribe software. Our study shows that this architecture yields a good balance between scalability and maintainability due to high cohesion and low coupling of the solution, as well as asynchronous communication between the layers. This architecture can help practitioners to improve their analytic solutions. It is also of interest to academics, as it is a building block for a general architecture for processing streaming data.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/02/2018

Online and Offline Analysis of Streaming Data

Online and offline analytics have been traditionally treated separately ...
research
09/14/2017

Scalable real-time processing with Spark Streaming: implementation and design of a Car Information System

Streaming data processing is a hot topic in big data these days, because...
research
11/03/2019

A Streaming Analytics Language for Processing Cyber Data

We present a domain-specific language called SAL(the Streaming Analytics...
research
07/15/2019

A Scalable Framework for Multilevel Streaming Data Analytics using Deep Learning

The rapid growth of data in velocity, volume, value, variety, and veraci...
research
01/06/2016

Streaming Gibbs Sampling for LDA Model

Streaming variational Bayes (SVB) is successful in learning LDA models i...
research
08/09/2021

Towards a Generic Multimodal Architecture for Batch and Streaming Big Data Integration

Big Data are rapidly produced from various heterogeneous data sources. T...
research
05/26/2021

Cost models for geo-distributed massively parallel streaming analytics

This report is part of the DataflowOpt project on optimization of modern...

Please sign up or login with your details

Forgot password? Click here to reset