A Novel Micro-service Based Platform for Composition, Deployment and Execution of BDA Applications

by   Davide Profeta, et al.

Big Data are growing at an exponential rate and it becomes necessary the use of tools and technologies to manage, process and visualize them in order to extract value. In this paper a micro-service based platform is presented for the composition, deployment and execution of Big Data Analytics (BDA) application workflows in several domains and scenarios is presented. ALIDA is a result coming from previous research activities by ENGINEERING. It aims to achieve a unified platform that allows both BDA application developers and data analysts to interact with it. Developers will be able to register new BDA applications through the exposed API and/or through the web user interface. Data analysts will be able to use the BDA applications provided to create batch/stream workflows through a dashboard user interface to manipulate and subsequently visualize results from one or more sources. The platform also supports the auto-tuning of Big Data frameworks deployment properties to improve metrics for analytics application. ALIDA has been properly extended and integrated into a software solution for the analysis of large amounts of data from the avionic industries. A use case within this context is then presented.


page 1

page 4


Towards a Conceptual Approach of Analytical Engineering for Big Data

Analytics corresponds to a relevant and challenging phase of Big Data. T...

Context agnostic trajectory prediction based on λ-architecture

Predicting the next position of movable objects has been a problem for a...

Trend-Based Networking Driven by Big Data Telemetry for SDN and Traditional Networks

Organizations face a challenge of accurately analyzing network data and ...

A Secure Experimentation Sandbox for the design and execution of trusted and secure analytics in the aviation domain

The aviation industry as well as the industries that benefit and are lin...

ACCORDANT: A Domain Specific Model and DevOpsApproach for Big Data Analytics Architectures

Big data analytics (BDA) applications use machine learning algorithms to...

Impact of etcd Deployment on Kubernetes, Istio, and Application Performance

By intrinsic necessity, Kubernetes is a complex platform. Its complexity...

Please sign up or login with your details

Forgot password? Click here to reset