MLOps Challenges in Multi-Organization Setup: Experiences from Two Real-World Cases

03/16/2021
by   Tuomas Granlund, et al.
0

The emerging age of connected, digital world means that there are tons of data, distributed to various organizations and their databases. Since this data can be confidential in nature, it cannot always be openly shared in seek of artificial intelligence (AI) and machine learning (ML) solutions. Instead, we need integration mechanisms, analogous to integration patterns in information systems, to create multi-organization AI/ML systems. In this paper, we present two real-world cases. First, we study integration between two organizations in detail. Second, we address scaling of AI/ML to multi-organization context. The setup we assume is that of continuous deployment, often referred to DevOps in software development. When also ML components are deployed in a similar fashion, term MLOps is used. Towards the end of the paper, we list the main observations and draw some final conclusions. Finally, we propose some directions for future work.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/07/2023

Operationalizing AI in Future Networks: A Bird's Eye View from the System Perspective

Modern Artificial Intelligence (AI) technologies, led by Machine Learnin...
research
03/23/2022

What is Software Quality for AI Engineers? Towards a Thinning of the Fog

It is often overseen that AI-enabled systems are also software systems a...
research
03/03/2023

MLTEing Models: Negotiating, Evaluating, and Documenting Model and System Qualities

Many organizations seek to ensure that machine learning (ML) and artific...
research
03/12/2019

Termite: A System for Tunneling Through Heterogeneous Data

Data-driven analysis is important in virtually every modern organization...
research
02/21/2022

Machine Learning Operations: A Survey on MLOps Tool Support

Machine Learning (ML) has become a fast-growing, trending approach in so...
research
10/18/2022

Generalizing in the Real World with Representation Learning

Machine learning (ML) formalizes the problem of getting computers to lea...
research
08/31/2020

A Multisite, Report-Based, Centralized Infrastructure for Feedback and Monitoring of Radiology AI/ML Development and Clinical Deployment

An infrastructure for multisite, geographically-distributed creation and...

Please sign up or login with your details

Forgot password? Click here to reset