DeepAI AI Chat
Log In Sign Up

A Novel Micro-service Based Platform for Composition, Deployment and Execution of BDA Applications

by   Davide Profeta, et al.

Big Data are growing at an exponential rate and it becomes necessary the use of tools and technologies to manage, process and visualize them in order to extract value. In this paper a micro-service based platform is presented for the composition, deployment and execution of Big Data Analytics (BDA) application workflows in several domains and scenarios is presented. ALIDA is a result coming from previous research activities by ENGINEERING. It aims to achieve a unified platform that allows both BDA application developers and data analysts to interact with it. Developers will be able to register new BDA applications through the exposed API and/or through the web user interface. Data analysts will be able to use the BDA applications provided to create batch/stream workflows through a dashboard user interface to manipulate and subsequently visualize results from one or more sources. The platform also supports the auto-tuning of Big Data frameworks deployment properties to improve metrics for analytics application. ALIDA has been properly extended and integrated into a software solution for the analysis of large amounts of data from the avionic industries. A use case within this context is then presented.


page 1

page 4


Towards a Conceptual Approach of Analytical Engineering for Big Data

Analytics corresponds to a relevant and challenging phase of Big Data. T...

Context agnostic trajectory prediction based on λ-architecture

Predicting the next position of movable objects has been a problem for a...

Trend-Based Networking Driven by Big Data Telemetry for SDN and Traditional Networks

Organizations face a challenge of accurately analyzing network data and ...

ACCORDANT: A Domain Specific Model and DevOpsApproach for Big Data Analytics Architectures

Big data analytics (BDA) applications use machine learning algorithms to...

Impact of etcd Deployment on Kubernetes, Istio, and Application Performance

By intrinsic necessity, Kubernetes is a complex platform. Its complexity...

Revisiting Active Object Stores: Bringing Data Locality to the Limit With NVM

Object stores are widely used software stacks that achieve excellent sca...