Continual learning on deployment pipelines for Machine Learning Systems

12/05/2022
by   Qiang Li, et al.
0

Following the development of digitization, a growing number of large Original Equipment Manufacturers (OEMs) are adapting computer vision or natural language processing in a wide range of applications such as anomaly detection and quality inspection in plants. Deployment of such a system is becoming an extremely important topic. Our work starts with the least-automated deployment technologies of machine learning systems includes several iterations of updates, and ends with a comparison of automated deployment techniques. The objective is, on the one hand, to compare the advantages and disadvantages of various technologies in theory and practice, so as to facilitate later adopters to avoid making the generalized mistakes when implementing actual use cases, and thereby choose a better strategy for their own enterprises. On the other hand, to raise awareness of the evaluation framework for the deployment of machine learning systems, to have more comprehensive and useful evaluation metrics (e.g. table 2), rather than only focusing on a single factor (e.g. company cost). This is especially important for decision-makers in the industry.

READ FULL TEXT

page 6

page 7

page 8

page 11

research
11/28/2019

Computer Systems Have 99 Problems, Let's Not Make Machine Learning Another One

Machine learning techniques are finding many applications in computer sy...
research
12/16/2022

An Efficient Framework for Monitoring Subgroup Performance of Machine Learning Systems

Monitoring machine learning systems post deployment is critical to ensur...
research
07/09/2020

Green Lighting ML: Confidentiality, Integrity, and Availability of Machine Learning Systems in Deployment

Security and ethics are both core to ensuring that a machine learning sy...
research
06/21/2020

Technology Readiness Levels for Machine Learning Systems

The development and deployment of machine learning systems can be execut...
research
12/13/2021

Can Machine Learning be Moral?

The ethics of Machine Learning has become an unavoidable topic in the AI...
research
02/26/2019

Grammar Based Directed Testing of Machine Learning Systems

The massive progress of machine learning has seen its application over a...
research
12/14/2018

Helix: Holistic Optimization for Accelerating Iterative Machine Learning

Machine learning workflow development is a process of trial-and-error: d...

Please sign up or login with your details

Forgot password? Click here to reset