Real-world Machine Learning Systems: A survey from a Data-Oriented Architecture Perspective

by   Christian Cabrera, et al.
University of Cambridge

With the upsurge of interest in artificial intelligence machine learning (ML) algorithms, originally developed in academic environments, are now being deployed as parts of real-life systems that deal with large amounts of heterogeneous, dynamic, and high-dimensional data. Deployment of ML methods in real life is prone to challenges across the whole system life-cycle from data management to systems deployment, monitoring, and maintenance. Data-Oriented Architecture (DOA) is an emerging software engineering paradigm that has the potential to mitigate these challenges by proposing a set of principles to create data-driven, loosely coupled, decentralised, and open systems. However DOA as a concept is not widespread yet, and there is no common understanding of how it can be realised in practice. This review addresses that problem by contextualising the principles that underpin the DOA paradigm through the ML system challenges. We explore the extent to which current architectures of ML-based real-world systems have implemented the DOA principles. We also formulate open research challenges and directions for further development of the DOA paradigm.


page 13

page 15

page 17


An Empirical Evaluation of Flow Based Programming in the Machine Learning Deployment Context

As use of data driven technologies spreads, software engineers are more ...

Machine learning in bioprocess development: From promise to practice

Fostered by novel analytical techniques, digitalization and automation, ...

RLOps: Development Life-cycle of Reinforcement Learning Aided Open RAN

Radio access network (RAN) technologies continue to witness massive grow...

In the Wild: From ML Models to Pragmatic ML Systems

Enabling robust intelligence in the wild entails learning systems that o...

Learning machines for health and beyond

Machine learning techniques are effective for building predictive models...

Uncertainty-aware Remaining Useful Life predictor

Remaining Useful Life (RUL) estimation is the problem of inferring how l...

Please sign up or login with your details

Forgot password? Click here to reset