Real-world Machine Learning Systems: A survey from a Data-Oriented Architecture Perspective

02/09/2023
by   Christian Cabrera, et al.
University of Cambridge
0

With the upsurge of interest in artificial intelligence machine learning (ML) algorithms, originally developed in academic environments, are now being deployed as parts of real-life systems that deal with large amounts of heterogeneous, dynamic, and high-dimensional data. Deployment of ML methods in real life is prone to challenges across the whole system life-cycle from data management to systems deployment, monitoring, and maintenance. Data-Oriented Architecture (DOA) is an emerging software engineering paradigm that has the potential to mitigate these challenges by proposing a set of principles to create data-driven, loosely coupled, decentralised, and open systems. However DOA as a concept is not widespread yet, and there is no common understanding of how it can be realised in practice. This review addresses that problem by contextualising the principles that underpin the DOA paradigm through the ML system challenges. We explore the extent to which current architectures of ML-based real-world systems have implemented the DOA principles. We also formulate open research challenges and directions for further development of the DOA paradigm.

READ FULL TEXT

page 13

page 15

page 17

04/27/2022

An Empirical Evaluation of Flow Based Programming in the Machine Learning Deployment Context

As use of data driven technologies spreads, software engineers are more ...
10/04/2022

Machine learning in bioprocess development: From promise to practice

Fostered by novel analytical techniques, digitalization and automation, ...
11/12/2021

RLOps: Development Life-cycle of Reinforcement Learning Aided Open RAN

Radio access network (RAN) technologies continue to witness massive grow...
07/06/2020

In the Wild: From ML Models to Pragmatic ML Systems

Enabling robust intelligence in the wild entails learning systems that o...
03/02/2023

Learning machines for health and beyond

Machine learning techniques are effective for building predictive models...
04/08/2021

Uncertainty-aware Remaining Useful Life predictor

Remaining Useful Life (RUL) estimation is the problem of inferring how l...

Please sign up or login with your details

Forgot password? Click here to reset